Date: (Mon) Jun 13, 2016

Introduction:

Data: Source: Training: “https://inclass.kaggle.com/c/can-we-predict-voting-outcomes/download/train2016.csv
New: “https://inclass.kaggle.com/c/can-we-predict-voting-outcomes/download/test2016.csv
Time period:

Synopsis:

Based on analysis utilizing <> techniques, :

Summary of key steps & error improvement stats:

Prediction Accuracy Enhancement Options:

  • transform.data chunk:
    • derive features from multiple features
  • manage.missing.data chunk:
    • Not fill missing vars
    • Fill missing numerics with a different algorithm
    • Fill missing chars with data based on clusters

[](.png)

Potential next steps include:

  • Organization:
    • Categorize by chunk
    • Priority criteria:
      1. Ease of change
      2. Impacts report
      3. Cleans innards
      4. Bug report
  • all chunks:
    • at chunk-end rm(!glb_)
  • manage.missing.data chunk:
    • cleaner way to manage re-splitting of training vs. new entity
  • extract.features chunk:
    • Add n-grams for glbFeatsText
      • “RTextTools”, “tau”, “RWeka”, and “textcat” packages
  • fit.models chunk:
    • Classification: Plot AUC Curves for all models & highlight glbMdlSel
    • Prediction accuracy scatter graph:
    • Add tiles (raw vs. PCA)
    • Use shiny for drop-down of “important” features
    • Use plot.ly for interactive plots ?

    • Change .fit suffix of model metrics to .mdl if it’s data independent (e.g. AIC, Adj.R.Squared - is it truly data independent ?, etc.)
    • create a custom model for rpart that has minbucket as a tuning parameter
    • varImp for randomForest crashes in caret version:6.0.41 -> submit bug report

  • Probability handling for multinomials vs. desired binomial outcome
  • ROCR currently supports only evaluation of binary classification tasks (version 1.0.7)
  • extensions toward multiclass classification are scheduled for the next release

  • fit.all.training chunk:
    • myplot_prediction_classification: displays ‘x’ instead of ‘+’ when there are no prediction errors
  • Compare glb_sel_mdl vs. glb_fin_mdl:
    • varImp
    • Prediction differences (shd be minimal ?)
  • Move glb_analytics_diag_plots to mydsutils.R: (+) Easier to debug (-) Too many glb vars used
  • Add print(ggplot.petrinet(glb_analytics_pn) + coord_flip()) at the end of every major chunk
  • Parameterize glb_analytics_pn
  • Move glb_impute_missing_data to mydsutils.R: (-) Too many glb vars used; glb_<>_df reassigned
  • Do non-glm methods handle interaction terms ?
  • f-score computation for classifiers should be summation across outcomes (not just the desired one ?)
  • Add accuracy computation to glb_dmy_mdl in predict.data.new chunk
  • Why does splitting fit.data.training.all chunk into separate chunks add an overhead of ~30 secs ? It’s not rbind b/c other chunks have lower elapsed time. Is it the number of plots ?
  • Incorporate code chunks in print_sessionInfo
  • Test against
    • projects in github.com/bdanalytics
    • lectures in jhu-datascience track

Analysis:

rm(list = ls())
set.seed(12345)
options(stringsAsFactors = FALSE)
source("~/Dropbox/datascience/R/mycaret.R")
source("~/Dropbox/datascience/R/mypetrinet.R")
source("~/Dropbox/datascience/R/myplclust.R")
source("~/Dropbox/datascience/R/myplot.R")
source("~/Dropbox/datascience/R/myscript.R")
source("~/Dropbox/datascience/R/mytm.R")
if (is.null(knitr::opts_current$get(name = 'label'))) # Running in IDE
    debugSource("~/Dropbox/datascience/R/mydsutils.R") else
    source("~/Dropbox/datascience/R/mydsutils.R")    
## Loading required package: caret
## Loading required package: lattice
# Gather all package requirements here
suppressPackageStartupMessages(require(doMC))
glbCores <- 10 # of cores on machine - 2
registerDoMC(glbCores) 

suppressPackageStartupMessages(require(caret))
require(plyr)
## Loading required package: plyr
require(dplyr)
## Loading required package: dplyr
## 
## Attaching package: 'dplyr'
## The following objects are masked from 'package:plyr':
## 
##     arrange, count, desc, failwith, id, mutate, rename, summarise,
##     summarize
## The following objects are masked from 'package:stats':
## 
##     filter, lag
## The following objects are masked from 'package:base':
## 
##     intersect, setdiff, setequal, union
require(knitr)
## Loading required package: knitr
require(stringr)
## Loading required package: stringr
#source("dbgcaret.R")
#packageVersion("snow")
#require(sos); findFn("cosine", maxPages=2, sortby="MaxScore")

# Analysis control global variables
# Inputs
#   url/name = "<PathPointer>"; if url specifies a zip file, name = "<filename>"; 
#               or named collection of <PathPointer>s
#   sep = choose from c(NULL, "\t")
glbObsTrnFile <- list(url = "https://inclass.kaggle.com/c/can-we-predict-voting-outcomes/download/train2016.csv"
    # or list(url = c(NULL, <.inp1> = "<path1>", <.inp2> = "<path2>"))
    #, splitSpecs = list(method = "copy" # default when glbObsNewFile is NULL
    #                       select from c("copy", NULL ???, "condition", "sample", )
    #                      ,nRatio = 0.3 # > 0 && < 1 if method == "sample" 
    #                      ,seed = 123 # any integer or glbObsTrnPartitionSeed if method == "sample" 
    #                      ,condition = # or 'is.na(<var>)'; '<var> <condition_operator> <value>'    
    #                      )
    )                   
 
glbObsNewFile <- list(url = "https://inclass.kaggle.com/c/can-we-predict-voting-outcomes/download/test2016.csv") 

glbObsDropCondition <- #NULL # : default
#   enclose in single-quotes b/c condition might include double qoutes
#       use | & ; NOT || &&    
#   '<condition>' 
    # 'grepl("^First Draft Video:", glbObsAll$Headline)'
    # 'is.na(glbObsAll[, glb_rsp_var_raw])'
    # '(is.na(glbObsAll[, glb_rsp_var_raw]) & grepl("Train", glbObsAll[, glbFeatsId]))'
    # 'is.na(strptime(glbObsAll[, "Date"], glbFeatsDateTime[["Date"]]["format"], tz = glbFeatsDateTime[["Date"]]["timezone"]))'
# '(is.na(glbObsAll[, "Q109244"]) | (glbObsAll[, "Q109244"] != "No"))' # No
'(glbObsAll[, "Q109244"] != "")' # NA
#nrow(do.call("subset",list(glbObsAll, parse(text=paste0("!(", glbObsDropCondition, ")")))))
    
glb_obs_repartition_train_condition <- NULL # : default
#    "<condition>" 

glb_max_fitobs <- NULL # or any integer
glbObsTrnPartitionSeed <- 123 # or any integer
                         
glb_is_regression <- FALSE; glb_is_classification <- !glb_is_regression; 
    glb_is_binomial <- TRUE # or TRUE or FALSE

glb_rsp_var_raw <- "Party"

# for classification, the response variable has to be a factor
glb_rsp_var <- "Party.fctr"

# if the response factor is based on numbers/logicals e.g (0/1 OR TRUE/FALSE vs. "A"/"B"), 
#   or contains spaces (e.g. "Not in Labor Force")
#   caret predict(..., type="prob") crashes
glb_map_rsp_raw_to_var <- #NULL 
function(raw) {
#     return(raw ^ 0.5)
#     return(log(raw))
#     return(log(1 + raw))
#     return(log10(raw)) 
#     return(exp(-raw / 2))
#     
# chk ref value against frequencies vs. alpha sort order
    ret_vals <- rep_len(NA, length(raw)); ret_vals[!is.na(raw)] <- ifelse(raw[!is.na(raw)] == "Republican", "R", "D"); return(relevel(as.factor(ret_vals), ref = "D")) 
    
#     as.factor(paste0("B", raw))
#     as.factor(gsub(" ", "\\.", raw))
    }

#if glb_rsp_var_raw is numeric:
#print(summary(glbObsAll[, glb_rsp_var_raw]))
#glb_map_rsp_raw_to_var(tst <- c(NA, as.numeric(summary(glbObsAll[, glb_rsp_var_raw])))) 

#if glb_rsp_var_raw is character:
#print(table(glbObsAll[, glb_rsp_var_raw], useNA = "ifany"))
# print(table(glb_map_rsp_raw_to_var(tst <- glbObsAll[, glb_rsp_var_raw]), useNA = "ifany"))

glb_map_rsp_var_to_raw <- #NULL 
function(var) {
#     return(var ^ 2.0)
#     return(exp(var))
#     return(10 ^ var) 
#     return(-log(var) * 2)
#     as.numeric(var)
#     levels(var)[as.numeric(var)]
    sapply(levels(var)[as.numeric(var)], function(elm) 
        if (is.na(elm)) return(elm) else
        if (elm == 'R') return("Republican") else
        if (elm == 'D') return("Democrat") else
        stop("glb_map_rsp_var_to_raw: unexpected value: ", elm)
        )  
#     gsub("\\.", " ", levels(var)[as.numeric(var)])
#     c("<=50K", " >50K")[as.numeric(var)]
#     c(FALSE, TRUE)[as.numeric(var)]
}
# print(table(glb_map_rsp_var_to_raw(glb_map_rsp_raw_to_var(tst)), useNA = "ifany"))

if ((glb_rsp_var != glb_rsp_var_raw) && is.null(glb_map_rsp_raw_to_var))
    stop("glb_map_rsp_raw_to_var function expected")

# List info gathered for various columns
# <col_name>:   <description>; <notes>
# USER_ID - an anonymous id unique to a given user
# YOB - the year of birth of the user
# Gender - the gender of the user, either Male or Female
# Income - the household income of the user. Either not provided, or one of "under $25,000", "$25,001 - $50,000", "$50,000 - $74,999", "$75,000 - $100,000", "$100,001 - $150,000", or "over $150,000".
# HouseholdStatus - the household status of the user. Either not provided, or one of "Domestic Partners (no kids)", "Domestic Partners (w/kids)", "Married (no kids)", "Married (w/kids)", "Single (no kids)", or "Single (w/kids)".
# EducationalLevel - the education level of the user. Either not provided, or one of "Current K-12", "High School Diploma", "Current Undergraduate", "Associate's Degree", "Bachelor's Degree", "Master's Degree", or "Doctoral Degree".
# Party - the political party for whom the user intends to vote for. Either "Democrat" or "Republican
# Q124742, Q124122, . . . , Q96024 - 101 different questions that the users were asked on Show of Hands. If the user didn't answer the question, there is a blank. For information about the question text and possible answers, see the file Questions.pdf.

# currently does not handle more than 1 column; consider concatenating multiple columns
# If glbFeatsId == NULL, ".rownames <- as.numeric(row.names())" is the default
glbFeatsId <- "USER_ID" # choose from c(NULL : default, "<id_feat>") 
glbFeatsCategory <- "Hhold.fctr" # choose from c(NULL : default, "<category_feat>")
# glbFeatsCategory <- "Q109244.fctr" # choose from c(NULL : default, "<category_feat>")
# glbFeatsCategory <- "Q115611.fctr" # choose from c(NULL : default, "<category_feat>")

# User-specified exclusions
glbFeatsExclude <- c(NULL
#   Feats that shd be excluded due to known causation by prediction variable
# , "<feat1", "<feat2>"
#   Feats that are factors with unique values (as % of nObs) > 49 (empirically derived)
#   Feats that are linear combinations (alias in glm)
#   Feature-engineering phase -> start by excluding all features except id & category & 
#       work each one in
    , "USER_ID", "YOB", "Gender", "Income", "HouseholdStatus", "EducationLevel" 
    ,"Q124742","Q124122" 
    ,"Q123621","Q123464"
    ,"Q122771","Q122770","Q122769","Q122120"
    ,"Q121700","Q121699","Q121011"
    ,"Q120978","Q120650","Q120472","Q120379","Q120194","Q120014","Q120012" 
    ,"Q119851","Q119650","Q119334"
    ,"Q118892","Q118237","Q118233","Q118232","Q118117"
    ,"Q117193","Q117186"
    ,"Q116797","Q116881","Q116953","Q116601","Q116441","Q116448","Q116197"
    ,"Q115602","Q115777","Q115610","Q115611","Q115899","Q115390","Q115195"
    ,"Q114961","Q114748","Q114517","Q114386","Q114152"
    ,"Q113992","Q113583","Q113584","Q113181"
    ,"Q112478","Q112512","Q112270"
    ,"Q111848","Q111580","Q111220"
    ,"Q110740"
    ,"Q109367","Q109244"
    ,"Q108950","Q108855","Q108617","Q108856","Q108754","Q108342","Q108343"
    ,"Q107869","Q107491"
    ,"Q106993","Q106997","Q106272","Q106388","Q106389","Q106042"
    ,"Q105840","Q105655"
    ,"Q104996"
    ,"Q103293"
    ,"Q102906","Q102674","Q102687","Q102289","Q102089"
    ,"Q101162","Q101163","Q101596"
    ,"Q100689","Q100680","Q100562","Q100010"
    ,"Q99982"
    ,"Q99716"
    ,"Q99581"
    ,"Q99480"
    ,"Q98869"
    ,"Q98578"
    ,"Q98197"
    ,"Q98059","Q98078"
    ,"Q96024" # Done
    ,".pos") 
if (glb_rsp_var_raw != glb_rsp_var)
    glbFeatsExclude <- union(glbFeatsExclude, glb_rsp_var_raw)                    

glbFeatsInteractionOnly <- list()
#glbFeatsInteractionOnly[["<child_feat>"]] <- "<parent_feat>"
glbFeatsInteractionOnly[["YOB.Age.dff"]] <- "YOB.Age.fctr"

glbFeatsDrop <- c(NULL
                # , "<feat1>", "<feat2>"
                )

glb_map_vars <- NULL # or c("<var1>", "<var2>")
glb_map_urls <- list();
# glb_map_urls[["<var1>"]] <- "<var1.url>"

# Derived features; Use this mechanism to cleanse data ??? Cons: Data duplication ???
glbFeatsDerive <- list();

# glbFeatsDerive[["<feat.my.sfx>"]] <- list(
#     mapfn = function(<arg1>, <arg2>) { return(function(<arg1>, <arg2>)) } 
#   , args = c("<arg1>", "<arg2>"))
#myprint_df(data.frame(ImageId = mapfn(glbObsAll$.src, glbObsAll$.pos)))
#data.frame(ImageId = mapfn(glbObsAll$.src, glbObsAll$.pos))[7045:7055, ]

    # character
#     mapfn = function(Education) { raw <- Education; raw[is.na(raw)] <- "NA.my"; return(as.factor(raw)) } 
#     mapfn = function(Week) { return(substr(Week, 1, 10)) }
#     mapfn = function(Name) { return(sapply(Name, function(thsName) 
#                                             str_sub(unlist(str_split(thsName, ","))[1], 1, 1))) } 

#     mapfn = function(descriptor) { return(plyr::revalue(descriptor, c(
#         "ABANDONED BUILDING"  = "OTHER",
#         "**"                  = "**"
#                                           ))) }

#     mapfn = function(description) { mod_raw <- description;
    # This is here because it does not work if it's in txt_map_filename
#         mod_raw <- gsub(paste0(c("\n", "\211", "\235", "\317", "\333"), collapse = "|"), " ", mod_raw)
    # Don't parse for "." because of ".com"; use customized gsub for that text
#         mod_raw <- gsub("(\\w)(!|\\*|,|-|/)(\\w)", "\\1\\2 \\3", mod_raw);
    # Some state acrnoyms need context for separation e.g. 
    #   LA/L.A. could either be "Louisiana" or "LosAngeles"
        # modRaw <- gsub("\\bL\\.A\\.( |,|')", "LosAngeles\\1", modRaw);
    #   OK/O.K. could either be "Oklahoma" or "Okay"
#         modRaw <- gsub("\\bACA OK\\b", "ACA OKay", modRaw); 
#         modRaw <- gsub("\\bNow O\\.K\\.\\b", "Now OKay", modRaw);        
    #   PR/P.R. could either be "PuertoRico" or "Public Relations"        
        # modRaw <- gsub("\\bP\\.R\\. Campaign", "PublicRelations Campaign", modRaw);        
    #   VA/V.A. could either be "Virginia" or "VeteransAdministration"        
        # modRaw <- gsub("\\bthe V\\.A\\.\\:", "the VeteranAffairs:", modRaw);
    #   
    # Custom mods

#         return(mod_raw) }

    # numeric
# Create feature based on record position/id in data   
glbFeatsDerive[[".pos"]] <- list(
    mapfn = function(raw1) { return(1:length(raw1)) }
    , args = c(".rnorm"))
# glbFeatsDerive[[".pos.y"]] <- list(
#     mapfn = function(raw1) { return(1:length(raw1)) }       
#     , args = c(".rnorm"))    

# Add logs of numerics that are not distributed normally
#   Derive & keep multiple transformations of the same feature, if normality is hard to achieve with just one transformation
#   Right skew: logp1; sqrt; ^ 1/3; logp1(logp1); log10; exp(-<feat>/constant)
# glbFeatsDerive[["WordCount.log1p"]] <- list(
#     mapfn = function(WordCount) { return(log1p(WordCount)) } 
#   , args = c("WordCount"))
# glbFeatsDerive[["WordCount.root2"]] <- list(
#     mapfn = function(WordCount) { return(WordCount ^ (1/2)) } 
#   , args = c("WordCount"))
# glbFeatsDerive[["WordCount.nexp"]] <- list(
#     mapfn = function(WordCount) { return(exp(-WordCount)) } 
#   , args = c("WordCount"))
#print(summary(glbObsAll$WordCount))
#print(summary(mapfn(glbObsAll$WordCount)))
    
# If imputation shd be skipped for this feature
# glbFeatsDerive[["District.fctr"]] <- list(
#     mapfn = function(District) {
#         raw <- District;
#         ret_vals <- rep_len("NA", length(raw)); 
#         ret_vals[!is.na(raw)] <- sapply(raw[!is.na(raw)], function(elm) 
#                                         ifelse(elm < 10, "1-9", 
#                                         ifelse(elm < 20, "10-19", "20+")));
#         return(relevel(as.factor(ret_vals), ref = "NA"))
#     }       
#     , args = c("District"))    

# YOB options:
# 1. Missing data:
# 1.1   0 -> Does not improve baseline
# 1.2   Cut factors & "NA" is a level
# 2. Data corrections: < 1928 & > 2000
# 3. Scale YOB
# 4. Add Age
# YOB.Age.fctr needs to be synced with YOB.Age.dff; Create a separate sub-function ???
glbFeatsDerive[["YOB.Age.fctr"]] <- list(
    mapfn = function(raw1) {
        raw <- 2016 - raw1 
        # raw[!is.na(raw) & raw >= 2010] <- NA
        raw[!is.na(raw) & (raw <= 15)] <- NA
        raw[!is.na(raw) & (raw >= 90)] <- NA        
        retVal <- rep_len("NA", length(raw))
        # breaks = c(1879, seq(1949, 1989, 10), 2049)
        # cutVal <- cut(raw[!is.na(raw)], breaks = breaks, 
        #               labels = as.character(breaks + 1)[1:(length(breaks) - 1)])
        cutVal <- cut(raw[!is.na(raw)], breaks = c(15, 20, 25, 30, 35, 40, 50, 65, 90))
        retVal[!is.na(raw)] <- levels(cutVal)[cutVal]
        return(factor(retVal, levels = c("NA"
                ,"(15,20]","(20,25]","(25,30]","(30,35]","(35,40]","(40,50]","(50,65]","(65,90]"),
                        ordered = TRUE))
    }
    , args = c("YOB"))

# YOB.Age.fctr needs to be synced with YOB.Age.dff; Create a separate sub-function ???
glbFeatsDerive[["YOB.Age.dff"]] <- list(
    mapfn = function(raw1) {
        raw <- 2016 - raw1 
        raw[!is.na(raw) & (raw <= 15)] <- NA
        raw[!is.na(raw) & (raw >= 90)] <- NA        
        breaks <- c(15, 20, 25, 30, 35, 40, 50, 65, 90)

        # retVal <- rep_len(0, length(raw))
        stopifnot(sum(!is.na(raw) && (raw <= 15)) == 0)
        stopifnot(sum(!is.na(raw) && (raw >= 90)) == 0) 
        # msk <- !is.na(raw) && (raw > 15) && (raw <= 20); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 15
        # msk <- !is.na(raw) && (raw > 20) && (raw <= 25); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 20
        # msk <- !is.na(raw) && (raw > 25) && (raw <= 30); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 25
        # msk <- !is.na(raw) && (raw > 30) && (raw <= 35); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 30
        # msk <- !is.na(raw) && (raw > 35) && (raw <= 40); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 35
        # msk <- !is.na(raw) && (raw > 40) && (raw <= 50); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 40
        # msk <- !is.na(raw) && (raw > 50) && (raw <= 65); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 50
        # msk <- !is.na(raw) && (raw > 65) && (raw <= 90); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 65

        breaks <- c(15, 20, 25, 30, 35, 40, 50, 65, 90)        
        retVal <- sapply(raw, function(age) {
            if (is.na(age)) return(0) else
            if ((age > 15) && (age <= 20)) return(age - 15) else
            if ((age > 20) && (age <= 25)) return(age - 20) else
            if ((age > 25) && (age <= 30)) return(age - 25) else
            if ((age > 30) && (age <= 35)) return(age - 30) else
            if ((age > 35) && (age <= 40)) return(age - 35) else
            if ((age > 40) && (age <= 50)) return(age - 40) else
            if ((age > 50) && (age <= 65)) return(age - 50) else
            if ((age > 65) && (age <= 90)) return(age - 65)
        })
        
        return(retVal)
    }
    , args = c("YOB"))

glbFeatsDerive[["Gender.fctr"]] <- list(
    mapfn = function(raw1) {
        raw <- raw1
        raw[raw %in% ""] <- "N"
        raw <- gsub("Male"  , "M", raw, fixed = TRUE)
        raw <- gsub("Female", "F", raw, fixed = TRUE)        
        return(relevel(as.factor(raw), ref = "N"))
    }
    , args = c("Gender"))

glbFeatsDerive[["Income.fctr"]] <- list(
    mapfn = function(raw1) { raw <- raw1;
        raw[raw %in% ""] <- "N"
        raw <- gsub("under $25,000"      , "<25K"    , raw, fixed = TRUE)
        raw <- gsub("$25,001 - $50,000"  , "25-50K"  , raw, fixed = TRUE)
        raw <- gsub("$50,000 - $74,999"  , "50-75K"  , raw, fixed = TRUE)
        raw <- gsub("$75,000 - $100,000" , "75-100K" , raw, fixed = TRUE)        
        raw <- gsub("$100,001 - $150,000", "100-150K", raw, fixed = TRUE)
        raw <- gsub("over $150,000"      , ">150K"   , raw, fixed = TRUE)        
        return(factor(raw, levels = c("N","<25K","25-50K","50-75K","75-100K","100-150K",">150K"),
                      ordered = TRUE))
    }
    , args = c("Income"))

glbFeatsDerive[["Hhold.fctr"]] <- list(
    mapfn = function(raw1) { raw <- raw1;
        raw[raw %in% ""] <- "N"
        raw <- gsub("Domestic Partners (no kids)", "PKn", raw, fixed = TRUE)
        raw <- gsub("Domestic Partners (w/kids)" , "PKy", raw, fixed = TRUE)        
        raw <- gsub("Married (no kids)"          , "MKn", raw, fixed = TRUE)
        raw <- gsub("Married (w/kids)"           , "MKy", raw, fixed = TRUE)        
        raw <- gsub("Single (no kids)"           , "SKn", raw, fixed = TRUE)
        raw <- gsub("Single (w/kids)"            , "SKy", raw, fixed = TRUE)        
        return(relevel(as.factor(raw), ref = "N"))
    }
    , args = c("HouseholdStatus"))

glbFeatsDerive[["Edn.fctr"]] <- list(
    mapfn = function(raw1) { raw <- raw1;
        raw[raw %in% ""] <- "N"
        raw <- gsub("Current K-12"         , "K12", raw, fixed = TRUE)
        raw <- gsub("High School Diploma"  , "HSD", raw, fixed = TRUE)        
        raw <- gsub("Current Undergraduate", "CCg", raw, fixed = TRUE)
        raw <- gsub("Associate's Degree"   , "Ast", raw, fixed = TRUE)
        raw <- gsub("Bachelor's Degree"    , "Bcr", raw, fixed = TRUE)        
        raw <- gsub("Master's Degree"      , "Msr", raw, fixed = TRUE)
        raw <- gsub("Doctoral Degree"      , "PhD", raw, fixed = TRUE)        
        return(factor(raw, levels = c("N","K12","HSD","CCg","Ast","Bcr","Msr","PhD"),
                      ordered = TRUE))
    }
    , args = c("EducationLevel"))

# for (qsn in c("Q124742","Q124122"))
# for (qsn in grep("Q12(.{4})(?!\\.fctr)", names(glbObsTrn), value = TRUE, perl = TRUE))
for (qsn in grep("Q", glbFeatsExclude, fixed = TRUE, value = TRUE))    
    glbFeatsDerive[[paste0(qsn, ".fctr")]] <- list(
        mapfn = function(raw1) {
            raw1[raw1 %in% ""] <- "NA"
            rawVal <- unique(raw1)
            
            if (length(setdiff(rawVal, (expVal <- c("NA", "No", "Ys")))) == 0) {
                raw1 <- gsub("Yes", "Ys", raw1, fixed = TRUE)
                if (length(setdiff(rawVal, expVal)) > 0)
                    stop(qsn, " vals: ", paste0(rawVal, collapse = "|"), 
                         " does not match expectation: ", paste0(expVal, collapse = "|"))
            } else
            if (length(setdiff(rawVal, (expVal <- c("NA", "Me", "Circumstances")))) == 0) {
                raw1 <- gsub("Circumstances", "Cs", raw1, fixed = TRUE)
                if (length(setdiff(rawVal, expVal)) > 0)
                    stop(qsn, " vals: ", paste0(rawVal, collapse = "|"), 
                         " does not match expectation: ", paste0(expVal, collapse = "|"))
            } else
            if (length(setdiff(rawVal, (expVal <- c("NA", "Grrr people", "Yay people!")))) == 0) {
                raw1 <- gsub("Grrr people", "Gr", raw1, fixed = TRUE)
                raw1 <- gsub("Yay people!", "Yy", raw1, fixed = TRUE)                
                if (length(setdiff(rawVal, expVal)) > 0)
                    stop(qsn, " vals: ", paste0(rawVal, collapse = "|"), 
                         " does not match expectation: ", paste0(expVal, collapse = "|"))
            } else
            if (length(setdiff(rawVal, (expVal <- c("NA", "Idealist", "Pragmatist")))) == 0) {
                raw1 <- gsub("Idealist"  , "Id", raw1, fixed = TRUE)
                raw1 <- gsub("Pragmatist", "Pr", raw1, fixed = TRUE)                
                if (length(setdiff(rawVal, expVal)) > 0)
                    stop(qsn, " vals: ", paste0(rawVal, collapse = "|"), 
                         " does not match expectation: ", paste0(expVal, collapse = "|"))
            } else
            if (length(setdiff(rawVal, (expVal <- c("NA", "Private", "Public")))) == 0) {
                raw1 <- gsub("Private", "Pt", raw1, fixed = TRUE)
                raw1 <- gsub("Public" , "Pc", raw1, fixed = TRUE)                
                if (length(setdiff(rawVal, expVal)) > 0)
                    stop(qsn, " vals: ", paste0(rawVal, collapse = "|"), 
                         " does not match expectation: ", paste0(expVal, collapse = "|"))
            }
            
            return(relevel(as.factor(raw1), ref = "NA"))
        }
        , args = c(qsn))

# If imputation of missing data is not working ...
# glbFeatsDerive[["FertilityRate.nonNA"]] <- list(
#     mapfn = function(FertilityRate, Region) {
#         RegionMdn <- tapply(FertilityRate, Region, FUN = median, na.rm = TRUE)
# 
#         retVal <- FertilityRate
#         retVal[is.na(FertilityRate)] <- RegionMdn[Region[is.na(FertilityRate)]]
#         return(retVal)
#     }
#     , args = c("FertilityRate", "Region"))
    
#     mapfn = function(HOSPI.COST) { return(cut(HOSPI.COST, 5, breaks = c(0, 100000, 200000, 300000, 900000), labels = NULL)) }     
#     mapfn = function(Rasmussen)  { return(ifelse(sign(Rasmussen) >= 0, 1, 0)) } 
#     mapfn = function(startprice) { return(startprice ^ (1/2)) }       
#     mapfn = function(startprice) { return(log(startprice)) }   
#     mapfn = function(startprice) { return(exp(-startprice / 20)) }
#     mapfn = function(startprice) { return(scale(log(startprice))) }     
#     mapfn = function(startprice) { return(sign(sprice.predict.diff) * (abs(sprice.predict.diff) ^ (1/10))) }        

    # factor      
#     mapfn = function(PropR) { return(as.factor(ifelse(PropR >= 0.5, "Y", "N"))) }
#     mapfn = function(productline, description) { as.factor(gsub(" ", "", productline)) }
#     mapfn = function(purpose) { return(relevel(as.factor(purpose), ref="all_other")) }
#     mapfn = function(raw) { tfr_raw <- as.character(cut(raw, 5)); 
#                             tfr_raw[is.na(tfr_raw)] <- "NA.my";
#                             return(as.factor(tfr_raw)) }
#     mapfn = function(startprice.log10) { return(cut(startprice.log10, 3)) }
#     mapfn = function(startprice.log10) { return(cut(sprice.predict.diff, c(-1000, -100, -10, -1, 0, 1, 10, 100, 1000))) }    

#     , args = c("<arg1>"))
    
    # multiple args
#     mapfn = function(id, date) { return(paste(as.character(id), as.character(date), sep = "#")) }        
#     mapfn = function(PTS, oppPTS) { return(PTS - oppPTS) }
#     mapfn = function(startprice.log10.predict, startprice) {
#                  return(spdiff <- (10 ^ startprice.log10.predict) - startprice) } 
#     mapfn = function(productline, description) { as.factor(
#         paste(gsub(" ", "", productline), as.numeric(nchar(description) > 0), sep = "*")) }
#     mapfn = function(.src, .pos) { 
#         return(paste(.src, sprintf("%04d", 
#                                    ifelse(.src == "Train", .pos, .pos - 7049)
#                                    ), sep = "#")) }       

# # If glbObsAll is not sorted in the desired manner
#     mapfn=function(Week) { return(coredata(lag(zoo(orderBy(~Week, glbObsAll)$ILI), -2, na.pad=TRUE))) }
#     mapfn=function(ILI) { return(coredata(lag(zoo(ILI), -2, na.pad=TRUE))) }
#     mapfn=function(ILI.2.lag) { return(log(ILI.2.lag)) }

# glbFeatsDerive[["<var1>"]] <- glbFeatsDerive[["<var2>"]]

# tst <- "descr.my"; args_lst <- NULL; for (arg in glbFeatsDerive[[tst]]$args) args_lst[[arg]] <- glbObsAll[, arg]; print(head(args_lst[[arg]])); print(head(drv_vals <- do.call(glbFeatsDerive[[tst]]$mapfn, args_lst))); 
# print(which_ix <- which(args_lst[[arg]] == 0.75)); print(drv_vals[which_ix]); 

glbFeatsDateTime <- list()
# Use OlsonNames() to enumerate supported time zones
# glbFeatsDateTime[["<DateTimeFeat>"]] <- 
#     c(format = "%Y-%m-%d %H:%M:%S" or "%m/%e/%y", timezone = "US/Eastern", impute.na = TRUE, 
#       last.ctg = FALSE, poly.ctg = FALSE)

glbFeatsPrice <- NULL # or c("<price_var>")

glbFeatsImage <- list() #list(<imageFeat> = list(patchSize = 10)) # if patchSize not specified, no patch computation

glbFeatsText <- list()
Sys.setlocale("LC_ALL", "C") # For english
## [1] "C/C/C/C/C/en_US.UTF-8"
#glbFeatsText[["<TextFeature>"]] <- list(NULL,
#   ,names = myreplacePunctuation(str_to_lower(gsub(" ", "", c(NULL, 
#       <comma-separated-screened-names>
#   ))))
#   ,rareWords = myreplacePunctuation(str_to_lower(gsub(" ", "", c(NULL, 
#       <comma-separated-nonSCOWL-words>
#   ))))
#)

# Text Processing Step: custom modifications not present in txt_munge -> use glbFeatsDerive
# Text Processing Step: universal modifications
glb_txt_munge_filenames_pfx <- "<projectId>_mytxt_"

# Text Processing Step: tolower
# Text Processing Step: myreplacePunctuation
# Text Processing Step: removeWords
glb_txt_stop_words <- list()
# Remember to use unstemmed words
if (length(glbFeatsText) > 0) {
    require(tm)
    require(stringr)

    glb_txt_stop_words[["<txt_var>"]] <- sort(myreplacePunctuation(str_to_lower(gsub(" ", "", c(NULL
        # Remove any words from stopwords            
#         , setdiff(myreplacePunctuation(stopwords("english")), c("<keep_wrd1>", <keep_wrd2>"))
                                
        # Remove salutations
        ,"mr","mrs","dr","Rev"                                

        # Remove misc
        #,"th" # Happy [[:digit::]]+th birthday 

        # Remove terms present in Trn only or New only; search for "Partition post-stem"
        #   ,<comma-separated-terms>        

        # cor.y.train == NA
#         ,unlist(strsplit(paste(c(NULL
#           ,"<comma-separated-terms>"
#         ), collapse=",")

        # freq == 1; keep c("<comma-separated-terms-to-keep>")
            # ,<comma-separated-terms>

        # chisq.pval high (e.g. == 1); keep c("<comma-separated-terms-to-keep>")
            # ,<comma-separated-terms>

        # nzv.freqRatio high (e.g. >= glbFeatsNzvFreqMax); keep c("<comma-separated-terms-to-keep>")
            # ,<comma-separated-terms>        
                                            )))))
}
#orderBy(~term, glb_post_stem_words_terms_df_lst[[txtFeat]][grep("^man", glb_post_stem_words_terms_df_lst[[txtFeat]]$term), ])
#glbObsAll[glb_post_stem_words_terms_mtrx_lst[[txtFeat]][, 4866] > 0, c(glb_rsp_var, txtFeat)]

# To identify terms with a specific freq
#paste0(sort(subset(glb_post_stop_words_terms_df_lst[[txtFeat]], freq == 1)$term), collapse = ",")
#paste0(sort(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], freq <= 2)$term), collapse = ",")
#subset(glb_post_stem_words_terms_df_lst[[txtFeat]], term %in% c("zinger"))

# To identify terms with a specific freq & 
#   are not stemmed together later OR is value of color.fctr (e.g. gold)
#paste0(sort(subset(glb_post_stop_words_terms_df_lst[[txtFeat]], (freq == 1) & !(term %in% c("blacked","blemish","blocked","blocks","buying","cables","careful","carefully","changed","changing","chargers","cleanly","cleared","connect","connects","connected","contains","cosmetics","default","defaulting","defective","definitely","describe","described","devices","displays","drop","drops","engravement","excellant","excellently","feels","fix","flawlessly","frame","framing","gentle","gold","guarantee","guarantees","handled","handling","having","install","iphone","iphones","keeped","keeps","known","lights","line","lining","liquid","liquidation","looking","lots","manuals","manufacture","minis","most","mostly","network","networks","noted","opening","operated","performance","performs","person","personalized","photograph","physically","placed","places","powering","pre","previously","products","protection","purchasing","returned","rotate","rotation","running","sales","second","seconds","shipped","shuts","sides","skin","skinned","sticker","storing","thats","theres","touching","unusable","update","updates","upgrade","weeks","wrapped","verified","verify") ))$term), collapse = ",")

#print(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], (freq <= 2)))
#glbObsAll[which(terms_mtrx[, 229] > 0), glbFeatsText]

# To identify terms with cor.y == NA
#orderBy(~-freq+term, subset(glb_post_stop_words_terms_df_lst[[txtFeat]], is.na(cor.y)))
#paste(sort(subset(glb_post_stop_words_terms_df_lst[[txtFeat]], is.na(cor.y))[, "term"]), collapse=",")
#orderBy(~-freq+term, subset(glb_post_stem_words_terms_df_lst[[txtFeat]], is.na(cor.y)))

# To identify terms with low cor.y.abs
#head(orderBy(~cor.y.abs+freq+term, subset(glb_post_stem_words_terms_df_lst[[txtFeat]], !is.na(cor.y))), 5)

# To identify terms with high chisq.pval
#subset(glb_post_stem_words_terms_df_lst[[txtFeat]], chisq.pval > 0.99)
#paste0(sort(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], (chisq.pval > 0.99) & (freq <= 10))$term), collapse=",")
#paste0(sort(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], (chisq.pval > 0.9))$term), collapse=",")
#head(orderBy(~-chisq.pval+freq+term, glb_post_stem_words_terms_df_lst[[txtFeat]]), 5)
#glbObsAll[glb_post_stem_words_terms_mtrx_lst[[txtFeat]][, 68] > 0, glbFeatsText]
#orderBy(~term, glb_post_stem_words_terms_df_lst[[txtFeat]][grep("^m", glb_post_stem_words_terms_df_lst[[txtFeat]]$term), ])

# To identify terms with high nzv.freqRatio
#summary(glb_post_stem_words_terms_df_lst[[txtFeat]]$nzv.freqRatio)
#paste0(sort(setdiff(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], (nzv.freqRatio >= glbFeatsNzvFreqMax) & (freq < 10) & (chisq.pval >= 0.05))$term, c( "128gb","3g","4g","gold","ipad1","ipad3","ipad4","ipadair2","ipadmini2","manufactur","spacegray","sprint","tmobil","verizon","wifion"))), collapse=",")

# To identify obs with a txt term
#tail(orderBy(~-freq+term, glb_post_stop_words_terms_df_lst[[txtFeat]]), 20)
#mydspObs(list(descr.my.contains="non"), cols=c("color", "carrier", "cellular", "storage"))
#grep("ever", dimnames(terms_stop_mtrx)$Terms)
#which(terms_stop_mtrx[, grep("ipad", dimnames(terms_stop_mtrx)$Terms)] > 0)
#glbObsAll[which(terms_stop_mtrx[, grep("16", dimnames(terms_stop_mtrx)$Terms)[1]] > 0), c(glbFeatsCategory, "storage", txtFeat)]

# Text Processing Step: screen for names # Move to glbFeatsText specs section in order of text processing steps
# glbFeatsText[["<txtFeat>"]]$names <- myreplacePunctuation(str_to_lower(gsub(" ", "", c(NULL
#         # Person names for names screening
#         ,<comma-separated-list>
#         
#         # Company names
#         ,<comma-separated-list>
#                     
#         # Product names
#         ,<comma-separated-list>
#     ))))

# glbFeatsText[["<txtFeat>"]]$rareWords <- myreplacePunctuation(str_to_lower(gsub(" ", "", c(NULL
#         # Words not in SCOWL db
#         ,<comma-separated-list>
#     ))))

# To identify char vectors post glbFeatsTextMap
#grep("six(.*)hour", glb_txt_chr_lst[[txtFeat]], ignore.case = TRUE, value = TRUE)
#grep("[S|s]ix(.*)[H|h]our", glb_txt_chr_lst[[txtFeat]], value = TRUE)

# To identify whether terms shd be synonyms
#orderBy(~term, glb_post_stop_words_terms_df_lst[[txtFeat]][grep("^moder", glb_post_stop_words_terms_df_lst[[txtFeat]]$term), ])
# term_row_df <- glb_post_stop_words_terms_df_lst[[txtFeat]][grep("^came$", glb_post_stop_words_terms_df_lst[[txtFeat]]$term), ]
# 
# cor(glb_post_stop_words_terms_mtrx_lst[[txtFeat]][glbObsAll$.lcn == "Fit", term_row_df$pos], glbObsTrn[, glb_rsp_var], use="pairwise.complete.obs")

# To identify which stopped words are "close" to a txt term
#sort(glbFeatsCluster)

# Text Processing Step: stemDocument
# To identify stemmed txt terms
#glb_post_stop_words_terms_df_lst[[txtFeat]][grep("^la$", glb_post_stop_words_terms_df_lst[[txtFeat]]$term), ]
#orderBy(~term, glb_post_stem_words_terms_df_lst[[txtFeat]][grep("^con", glb_post_stem_words_terms_df_lst[[txtFeat]]$term), ])
#glbObsAll[which(terms_stem_mtrx[, grep("use", dimnames(terms_stem_mtrx)$Terms)[[1]]] > 0), c(glbFeatsId, "productline", txtFeat)]
#glbObsAll[which(TfIdf_stem_mtrx[, 191] > 0), c(glbFeatsId, glbFeatsCategory, txtFeat)]
#glbObsAll[which(glb_post_stop_words_terms_mtrx_lst[[txtFeat]][, 6165] > 0), c(glbFeatsId, glbFeatsCategory, txtFeat)]
#which(glbObsAll$UniqueID %in% c(11915, 11926, 12198))

# Text Processing Step: mycombineSynonyms
#   To identify which terms are associated with not -> combine "could not" & "couldn't"
#findAssocs(glb_full_DTM_lst[[txtFeat]], "not", 0.05)
#   To identify which synonyms should be combined
#orderBy(~term, glb_post_stem_words_terms_df_lst[[txtFeat]][grep("^c", glb_post_stem_words_terms_df_lst[[txtFeat]]$term), ])
chk_comb_cor <- function(syn_lst) {
#     cor(terms_stem_mtrx[glbObsAll$.src == "Train", grep("^(damag|dent|ding)$", dimnames(terms_stem_mtrx)[[2]])], glbObsTrn[, glb_rsp_var], use="pairwise.complete.obs")
    print(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], term %in% syn_lst$syns))
    print(subset(get_corpus_terms(tm_map(glbFeatsTextCorpus[[txtFeat]], mycombineSynonyms, list(syn_lst), lazy=FALSE)), term == syn_lst$word))
#     cor(terms_stop_mtrx[glbObsAll$.src == "Train", grep("^(damage|dent|ding)$", dimnames(terms_stop_mtrx)[[2]])], glbObsTrn[, glb_rsp_var], use="pairwise.complete.obs")
#     cor(rowSums(terms_stop_mtrx[glbObsAll$.src == "Train", grep("^(damage|dent|ding)$", dimnames(terms_stop_mtrx)[[2]])]), glbObsTrn[, glb_rsp_var], use="pairwise.complete.obs")
}
#chk_comb_cor(syn_lst=list(word="cabl",  syns=c("cabl", "cord")))
#chk_comb_cor(syn_lst=list(word="damag",  syns=c("damag", "dent", "ding")))
#chk_comb_cor(syn_lst=list(word="dent",  syns=c("dent", "ding")))
#chk_comb_cor(syn_lst=list(word="use",  syns=c("use", "usag")))

glbFeatsTextSynonyms <- list()
# list parsed to collect glbFeatsText[[<txtFeat>]]$vldTerms
# glbFeatsTextSynonyms[["Hdln.my"]] <- list(NULL
#     # people in places
#     , list(word = "australia", syns = c("australia", "australian"))
#     , list(word = "italy", syns = c("italy", "Italian"))
#     , list(word = "newyork", syns = c("newyork", "newyorker"))    
#     , list(word = "Pakistan", syns = c("Pakistan", "Pakistani"))    
#     , list(word = "peru", syns = c("peru", "peruvian"))
#     , list(word = "qatar", syns = c("qatar", "qatari"))
#     , list(word = "scotland", syns = c("scotland", "scotish"))
#     , list(word = "Shanghai", syns = c("Shanghai", "Shanzhai"))    
#     , list(word = "venezuela", syns = c("venezuela", "venezuelan"))    
# 
#     # companies - needs to be data dependent 
#     #   - e.g. ensure BNP in this experiment/feat always refers to BNPParibas
#         
#     # general synonyms
#     , list(word = "Create", syns = c("Create","Creator")) 
#     , list(word = "cute", syns = c("cute","cutest"))     
#     , list(word = "Disappear", syns = c("Disappear","Fadeout"))     
#     , list(word = "teach", syns = c("teach", "taught"))     
#     , list(word = "theater",  syns = c("theater", "theatre", "theatres")) 
#     , list(word = "understand",  syns = c("understand", "understood"))    
#     , list(word = "weak",  syns = c("weak", "weaken", "weaker", "weakest"))
#     , list(word = "wealth",  syns = c("wealth", "wealthi"))    
#     
#     # custom synonyms (phrases)
#     
#     # custom synonyms (names)
#                                       )
#glbFeatsTextSynonyms[["<txtFeat>"]] <- list(NULL
#     , list(word="<stem1>",  syns=c("<stem1>", "<stem1_2>"))
#                                       )

for (txtFeat in names(glbFeatsTextSynonyms))
    for (entryIx in 1:length(glbFeatsTextSynonyms[[txtFeat]])) {
        glbFeatsTextSynonyms[[txtFeat]][[entryIx]]$word <-
            str_to_lower(glbFeatsTextSynonyms[[txtFeat]][[entryIx]]$word)
        glbFeatsTextSynonyms[[txtFeat]][[entryIx]]$syns <-
            str_to_lower(glbFeatsTextSynonyms[[txtFeat]][[entryIx]]$syns)        
    }        

glbFeatsTextSeed <- 181
# tm options include: check tm::weightSMART 
glb_txt_terms_control <- list( # Gather model performance & run-time stats
                    # weighting = function(x) weightSMART(x, spec = "nnn")
                    # weighting = function(x) weightSMART(x, spec = "lnn")
                    # weighting = function(x) weightSMART(x, spec = "ann")
                    # weighting = function(x) weightSMART(x, spec = "bnn")
                    # weighting = function(x) weightSMART(x, spec = "Lnn")
                    # 
                    weighting = function(x) weightSMART(x, spec = "ltn") # default
                    # weighting = function(x) weightSMART(x, spec = "lpn")                    
                    # 
                    # weighting = function(x) weightSMART(x, spec = "ltc")                    
                    # 
                    # weighting = weightBin 
                    # weighting = weightTf 
                    # weighting = weightTfIdf # : default
                # termFreq selection criteria across obs: tm default: list(global=c(1, Inf))
                    , bounds = list(global = c(1, Inf)) 
                # wordLengths selection criteria: tm default: c(3, Inf)
                    , wordLengths = c(1, Inf) 
                              ) 

glb_txt_cor_var <- glb_rsp_var # : default # or c(<feat>)

# select one from c("union.top.val.cor", "top.cor", "top.val", default: "top.chisq", "sparse")
glbFeatsTextFilter <- "top.chisq" 
glbFeatsTextTermsMax <- rep(10, length(glbFeatsText)) # :default
names(glbFeatsTextTermsMax) <- names(glbFeatsText)

# Text Processing Step: extractAssoc
glbFeatsTextAssocCor <- rep(1, length(glbFeatsText)) # :default 
names(glbFeatsTextAssocCor) <- names(glbFeatsText)

# Remember to use stemmed terms
glb_important_terms <- list()

# Text Processing Step: extractPatterns (ngrams)
glbFeatsTextPatterns <- list()
#glbFeatsTextPatterns[[<txtFeat>>]] <- list()
#glbFeatsTextPatterns[[<txtFeat>>]] <- c(metropolitan.diary.colon = "Metropolitan Diary:")

# Have to set it even if it is not used
# Properties:
#   numrows(glb_feats_df) << numrows(glbObsFit
#   Select terms that appear in at least 0.2 * O(FP/FN(glbObsOOB)) ???
#       numrows(glbObsOOB) = 1.1 * numrows(glbObsNew) ???
glb_sprs_thresholds <- NULL # or c(<txtFeat1> = 0.988, <txtFeat2> = 0.970, <txtFeat3> = 0.970)

glbFctrMaxUniqVals <- 20 # default: 20
glb_impute_na_data <- FALSE # or TRUE
glb_mice_complete.seed <- 144 # or any integer

glbFeatsCluster <- paste(grep("^Q.", glbFeatsExclude, value = TRUE), "fctr", sep = ".") # NULL : glbFeatsCluster <- c("YOB.Age.fctr", "Gender.fctr", "Income.fctr", 
                     # # "Hhold.fctr",
                     # "Edn.fctr",
                     # paste(grep("^Q.", glbFeatsExclude, value = TRUE), "fctr", sep = ".")) # NULL : default or c("<feat1>", "<feat2>")
# glbFeatsCluster <- grep(paste0("[", 
#                         toupper(paste0(substr(glbFeatsText, 1, 1), collapse = "")),
#                                       "]\\.[PT]\\."), 
#                                names(glbObsAll), value = TRUE)

glb_cluster.seed <- 189 # or any integer
glbClusterEntropyVar <- NULL # c(glb_rsp_var, as.factor(cut(glb_rsp_var, 3)), default: NULL)
glbFeatsClusterVarsExclude <- FALSE # default FALSE

glb_interaction_only_feats <- NULL # : default or c(<parent_feat> = "<child_feat>")

glbFeatsNzvFreqMax <- 19 # 19 : caret default
glbFeatsNzvUniqMin <- 10 # 10 : caret default

glbRFESizes <- list()
#glbRFESizes[["mdlFamily"]] <- c(4, 8, 16, 32, 64, 67, 68, 69) # Accuracy@69/70 = 0.8258
glbRFESizes[["RFE.X"]] <- c(4, 6, 7, 8, 9, 10, 16, 32, 64, 128, 253) # accuracy(8) = 0.5648
# glbRFESizes[["Final"]] <- c(8, 16, 32, 40, 44, 46, 48, 49, 50, 51, 52, 56, 64, 96, 128, 247) # accuracy(49) = 0.6164

glbRFEResults <- NULL

glbObsFitOutliers <- list()
# If outliers.n >= 10; consider concatenation of interaction vars
# glbObsFitOutliers[["<mdlFamily>"]] <- c(NULL
#     is.na(.rstudent)
#     max(.rstudent)
#     is.na(.dffits)
#     .hatvalues >= 0.99        
#     -38,167,642 < minmax(.rstudent) < 49,649,823    
#     , <comma-separated-<glbFeatsId>>
#                                     )
glbObsTrnOutliers <- list()
glbObsTrnOutliers[["Final"]] <- union(glbObsFitOutliers[["All.X"]],
                                c(NULL
                                ))

# Modify mdlId to (build & extract) "<FamilyId>#<Fit|Trn>#<caretMethod>#<preProc1.preProc2>#<samplingMethod>"
glb_models_lst <- list(); glb_models_df <- data.frame()

# Add xgboost algorithm

# Regression
if (glb_is_regression) {
    glbMdlMethods <- c(NULL
        # deterministic
            #, "lm", # same as glm
            , "glm", "bayesglm", "glmnet"
            , "rpart"
        # non-deterministic
            , "gbm", "rf" 
        # Unknown
            , "nnet" , "avNNet" # runs 25 models per cv sample for tunelength=5
            , "svmLinear", "svmLinear2"
            , "svmPoly" # runs 75 models per cv sample for tunelength=5
            , "svmRadial" 
            , "earth"
            , "bagEarth" # Takes a long time
            ,"xgbLinear","xgbTree"
        )
} else
# Classification - Add ada (auto feature selection)
    if (glb_is_binomial)
        glbMdlMethods <- c(NULL
        # deterministic                     
            , "bagEarth" # Takes a long time        
            , "glm", "bayesglm", "glmnet"
            , "nnet"
            , "rpart"
        # non-deterministic        
            , "gbm"
            , "avNNet" # runs 25 models per cv sample for tunelength=5      
            , "rf"
        # Unknown
            , "lda", "lda2"
                # svm models crash when predict is called -> internal to kernlab it should call predict without .outcome
            , "svmLinear", "svmLinear2"
            , "svmPoly" # runs 75 models per cv sample for tunelength=5
            , "svmRadial" 
            , "earth"
            ,"xgbLinear","xgbTree"
        ) else
        glbMdlMethods <- c(NULL
        # deterministic
            ,"glmnet"
        # non-deterministic 
            ,"rf"       
        # Unknown
            ,"gbm","rpart","xgbLinear","xgbTree"
        )

glbMdlFamilies <- list(); glb_mdl_feats_lst <- list()
# family: Choose from c("RFE.X", "Csm.X", "All.X", "Best.Interact") %*% c(NUll, ".NOr", ".Inc")
#   RFE = "Recursive Feature Elimination"
#   Csm = CuStoM
#   NOr = No OutlieRs
#   Inc = INteraCt
#   methods: Choose from c(NULL, <method>, glbMdlMethods) 
#glbMdlFamilies[["RFE.X"]] <- c("glmnet", "glm") # non-NULL vector is mandatory
if (glb_is_classification && !glb_is_binomial) {
    # glm does not work for multinomial
    glbMdlFamilies[["All.X"]] <- c("glmnet") 
} else {
    # glbMdlFamilies[["All.X"]] <- c("glmnet", "glm")
    # glbMdlFamilies[["All.X"]] <- c("glmnet")
    glbMdlFamilies[["All.X"]] <- setdiff(glbMdlMethods, c(NULL
        # , "bayesglm" # error: Error in trControl$classProbs && any(classLevels != make.names(classLevels)) : invalid 'x' type in 'x && y'
        , "lda" # error: model fit failed for Fold1.Rep1: parameter=none Error in lda.default(x, grouping, ...)
        ,"lda2" # error: There were missing values in resampled performance measures.
        , "svmLinear" # Error in .local(object, ...) : test vector does not match model ! In addition: Warning messages:
        , "svmLinear2" # SVM has not been trained using `probability = TRUE`, probabilities not available for predictions
        , "svmPoly" # runs 75 models per cv sample for tunelength=5 # took > 2 hrs # Error in .local(object, ...) : test vector does not match model !
        , "svmRadial" # Error in .local(object, ...) : test vector does not match model !
        ,"xgbLinear","xgbTree" # Need clang-omp compiler; Upgrade to Revolution R 3.2.3 (3.2.2 current); https://github.com/dmlc/xgboost/issues/276 thread
                                        ))

    # glbMdlFamilies[["RFE.X"]] <- c("glmnet", "glm")
    glbMdlFamilies[["RFE.X"]] <- c("glmnet")
    # glbMdlFamilies[["RFE.X"]] <- setdiff(glbMdlMethods, c(NULL
    #     # , "bayesglm" # error: Error in trControl$classProbs && any(classLevels != make.names(classLevels)) : invalid 'x' type in 'x && y'
    #     # , "lda","lda2" # error: Error in lda.default(x, grouping, ...) : variable 236 appears to be constant within groups
    #     , "svmLinear" # Error in .local(object, ...) : test vector does not match model ! In addition: Warning messages:
    #     , "svmLinear2" # SVM has not been trained using `probability = TRUE`, probabilities not available for predictions
    #     , "svmPoly" # runs 75 models per cv sample for tunelength=5 # took > 2 hrs # Error in .local(object, ...) : test vector does not match model !
    #     , "svmRadial" # Error in .local(object, ...) : test vector does not match model !
    #     ,"xgbLinear","xgbTree" # Need clang-omp compiler; Upgrade to Revolution R 3.2.3 (3.2.2 current); https://github.com/dmlc/xgboost/issues/276 thread
    #                                     ))
}
# glbMdlFamilies[["All.X.Inc"]] <- glbMdlFamilies[["All.X"]] # value not used
# glbMdlFamilies[["RFE.X.Inc"]] <- glbMdlFamilies[["RFE.X"]] # value not used

# Check if interaction features make RFE better
# glbMdlFamilies[["CSM.X"]] <- setdiff(glbMdlMethods, c("lda", "lda2")) # crashing due to category:.clusterid ??? #c("glmnet", "glm") # non-NULL list is mandatory
# glb_mdl_feats_lst[["CSM.X"]] <- c(NULL
#     , <comma-separated-features-vector>
#                                   )
# dAFeats.CSM.X %<d-% c(NULL
#     # Interaction feats up to varImp(RFE.X.glmnet) >= 50
#     , <comma-separated-features-vector>
#     , setdiff(myextract_actual_feats(predictors(glbRFEResults)), c(NULL
#                , <comma-separated-features-vector>
#                                                                       ))    
#                                   )
# glb_mdl_feats_lst[["CSM.X"]] <- "%<d-% dAFeats.CSM.X"

# glbMdlFamilies[["Final"]] <- c(NULL) # NULL vector acceptable # c("glmnet", "glm")

glbMdlAllowParallel <- list()
#glbMdlAllowParallel[["Final##rcv#glmnet"]] <- FALSE

glbMdlAllowParallel[["All.X##rcv#bayesglm"]] <- FALSE
glbMdlAllowParallel[["All.X##rcv#glm"]] <- FALSE
glbMdlAllowParallel[["All.X##rcv#lda"]] <- FALSE
glbMdlAllowParallel[["All.X##rcv#rpart"]] <- FALSE
glbMdlAllowParallel[["All.X#ica#rcv#glmnet"]] <- FALSE
glbMdlAllowParallel[["All.X#zv.pca#rcv#glmnet"]] <- FALSE
glbMdlAllowParallel[["All.X#zv.YeoJohnson.pca#rcv#glmnet"]] <- FALSE

# Check if tuning parameters make fit better; make it mdlFamily customizable ?
glbMdlTuneParams <- data.frame()

# When glmnet crashes at model$grid with error: ???
AllX__rcv_glmnetTuneParams <- rbind(data.frame() # alpha shd be <= 1.0 ALWAYS
    ,data.frame(parameter = "alpha",  vals = "0.100 0.325 0.550 0.775 1.000")
    ,data.frame(parameter = "lambda", vals = "0.0053781495 0.01 0.0249631588 0.03 0.04454817")
                        ) # max.Accuracy.OOB = 0.5981941 @ 0.775 0.02496316
AllX_YeoJohnson_rcv_glmnetTuneParams <- rbind(data.frame()
    ,data.frame(parameter = "alpha",  vals = "0.100 0.325 0.550 0.775 1.000")
    ,data.frame(parameter = "lambda", vals = "0.0053781495 0.01 0.0249631588 0.03 0.04454817")
                        ) # max.Accuracy.OOB = 0.6004515 @ 0.775 0.02496316
AllX_zvpca_rcv_glmnetTuneParams <- rbind(data.frame()
    ,data.frame(parameter = "alpha",  vals = "0.325 0.550 0.775 0.9 1.000")
    ,data.frame(parameter = "lambda", vals = "1.040899e-03 0.003 4.831424e-03 0.01 2.242548e-02")
                        ) # max.Accuracy.OOB = 0.6185102 @ 1.0 0.004831424
                          #                    0.616408  @ 0.9 0.004831424

glbMdlTuneParams <- rbind(glbMdlTuneParams
    ,cbind(data.frame(mdlId = "All.X##rcv#glmnet"),         AllX__rcv_glmnetTuneParams)
    ,cbind(data.frame(mdlId = "All.X#YeoJohnson#rcv#glmnet"), 
                                                            AllX_YeoJohnson_rcv_glmnetTuneParams)      ,cbind(data.frame(mdlId = "All.X#zv.pca#rcv#glmnet"), 
                                                            AllX_zvpca_rcv_glmnetTuneParams)   
)

    #avNNet    
    #   size=[1] 3 5 7 9; decay=[0] 1e-04 0.001  0.01   0.1; bag=[FALSE]; RMSE=1.3300906 

    #bagEarth
    #   degree=1 [2] 3; nprune=64 128 256 512 [1024]; RMSE=0.6486663 (up)
# bagEarthTuneParams <- rbind(data.frame()
#                         ,data.frame(parameter = "degree", vals = "1")
#                         ,data.frame(parameter = "nprune", vals = "256")
#                         )
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams,
#                                cbind(data.frame(mdlId = "Final.RFE.X.Inc##rcv#bagEarth"),
#                                      bagEarthTuneParams))

# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "bagEarth", parameter = "nprune", vals = "256")
#     ,data.frame(method = "bagEarth", parameter = "degree", vals = "2")    
# ))

    #earth 
    #   degree=[1]; nprune=2  [9] 17 25 33; RMSE=0.1334478
    
    #gbm 
    #   shrinkage=0.05 [0.10] 0.15 0.20 0.25; n.trees=100 150 200 [250] 300; interaction.depth=[1] 2 3 4 5; n.minobsinnode=[10]; RMSE=0.2008313     
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "gbm", parameter = "shrinkage", min = 0.05, max = 0.25, by = 0.05)
#     ,data.frame(method = "gbm", parameter = "n.trees", min = 100, max = 300, by = 50)
#     ,data.frame(method = "gbm", parameter = "interaction.depth", min = 1, max = 5, by = 1)
#     ,data.frame(method = "gbm", parameter = "n.minobsinnode", min = 10, max = 10, by = 10)
#     #seq(from=0.05,  to=0.25, by=0.05)
# ))

    #glmnet
    #   alpha=0.100 [0.325] 0.550 0.775 1.000; lambda=0.0005232693 0.0024288010 0.0112734954 [0.0523269304] 0.2428800957; RMSE=0.6164891
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "glmnet", parameter = "alpha", vals = "0.550 0.775 0.8875 0.94375 1.000")
#     ,data.frame(method = "glmnet", parameter = "lambda", vals = "9.858855e-05 0.0001971771 0.0009152152 0.0042480525 0.0197177130")    
# ))

    #nnet    
    #   size=3 5 [7] 9 11; decay=0.0001 0.001 0.01 [0.1] 0.2; RMSE=0.9287422
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "nnet", parameter = "size", vals = "3 5 7 9 11")
#     ,data.frame(method = "nnet", parameter = "decay", vals = "0.0001 0.0010 0.0100 0.1000 0.2000")    
# ))

    #rf # Don't bother; results are not deterministic
    #       mtry=2  35  68 [101] 134; RMSE=0.1339974
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "rf", parameter = "mtry", vals = "2 5 9 13 17")
# ))

    #rpart 
    #   cp=0.020 [0.025] 0.030 0.035 0.040; RMSE=0.1770237
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()    
#     ,data.frame(method = "rpart", parameter = "cp", vals = "0.004347826 0.008695652 0.017391304 0.021739130 0.034782609")
# ))
    
    #svmLinear
    #   C=0.01 0.05 [0.10] 0.50 1.00 2.00 3.00 4.00; RMSE=0.1271318; 0.1296718
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "svmLinear", parameter = "C", vals = "0.01 0.05 0.1 0.5 1")
# ))

    #svmLinear2    
    #   cost=0.0625 0.1250 [0.25] 0.50 1.00; RMSE=0.1276354 
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "svmLinear2", parameter = "cost", vals = "0.0625 0.125 0.25 0.5 1")
# ))

    #svmPoly    
    #   degree=[1] 2 3 4 5; scale=0.01 0.05 [0.1] 0.5 1; C=0.50 1.00 [2.00] 3.00 4.00; RMSE=0.1276130
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method="svmPoly", parameter="degree", min=1, max=5, by=1) #seq(1, 5, 1)
#     ,data.frame(method="svmPoly", parameter="scale", vals="0.01, 0.05, 0.1, 0.5, 1")
#     ,data.frame(method="svmPoly", parameter="C", vals="0.50, 1.00, 2.00, 3.00, 4.00")    
# ))

    #svmRadial
    #   sigma=[0.08674323]; C=0.25 0.50 1.00 [2.00] 4.00; RMSE=0.1614957
    
#glb2Sav(); all.equal(sav_models_df, glb_models_df)

pkgPreprocMethods <-     
# caret version: 6.0.068 # packageVersion("caret")
# operations are applied in this order: zero-variance filter, near-zero variance filter, Box-Cox/Yeo-Johnson/exponential transformation, centering, scaling, range, imputation, PCA, ICA then spatial sign
# *Impute methods needed only if NAs are fed to myfit_mdl
#   Also, ordered.factor in caret creates features as Edn.fctr^4 which is treated as an exponent by bagImpute
    c(NULL
      ,"zv", "nzv"
      ,"BoxCox", "YeoJohnson", "expoTrans"
      ,"center", "scale", "center.scale", "range"
      ,"knnImpute", "bagImpute", "medianImpute"
      ,"zv.pca", "ica", "spatialSign"
      ,"conditionalX") 

glbMdlPreprocMethods <- list(NULL # NULL # : default
    ,"All.X" = list("glmnet" = union(setdiff(pkgPreprocMethods,
                                            c("knnImpute", "bagImpute", "medianImpute")),
                                    # c(NULL)))
                                    c("zv.YeoJohnson.pca")))
    # ,"RFE.X" = list("glmnet" = union(setdiff(pkgPreprocMethods,
    #                                         c("knnImpute", "bagImpute", "medianImpute")),
    #                                 c(NULL)))
    #                                 # c("zv.pca.spatialSign")))
)
# glbMdlPreprocMethods[["RFE.X"]] <- list("glmnet" = union(unlist(glbMdlPreprocMethods[["All.X"]]),
#                                                     "nzv.pca.spatialSign"))

# Baseline prediction model feature(s)
glb_Baseline_mdl_var <- NULL # or c("<feat>")

glbMdlMetric_terms <- NULL # or matrix(c(
#                               0,1,2,3,4,
#                               2,0,1,2,3,
#                               4,2,0,1,2,
#                               6,4,2,0,1,
#                               8,6,4,2,0
#                           ), byrow=TRUE, nrow=5)
glbMdlMetricSummary <- NULL # or "<metric_name>"
glbMdlMetricMaximize <- NULL # or FALSE (TRUE is not the default for both classification & regression) 
glbMdlMetricSummaryFn <- NULL # or function(data, lev=NULL, model=NULL) {
#     confusion_mtrx <- t(as.matrix(confusionMatrix(data$pred, data$obs)))
#     #print(confusion_mtrx)
#     #print(confusion_mtrx * glbMdlMetric_terms)
#     metric <- sum(confusion_mtrx * glbMdlMetric_terms) / nrow(data)
#     names(metric) <- glbMdlMetricSummary
#     return(metric)
# }

glbMdlCheckRcv <- FALSE # Turn it on when needed; otherwise takes long time
glb_rcv_n_folds <- 3 # or NULL
glb_rcv_n_repeats <- 3 # or NULL

glb_clf_proba_threshold <- NULL # 0.5

# Model selection criteria
if (glb_is_regression)
    glbMdlMetricsEval <- c("min.RMSE.OOB", "max.R.sq.OOB", "min.elapsedtime.everything",
                           "max.Adj.R.sq.fit", "min.RMSE.fit")
    #glbMdlMetricsEval <- c("min.RMSE.fit", "max.R.sq.fit", "max.Adj.R.sq.fit")    
if (glb_is_classification) {
    if (glb_is_binomial)
        glbMdlMetricsEval <- 
            c("max.Accuracy.OOB", "max.AUCROCR.OOB", "max.AUCpROC.OOB",
              "min.elapsedtime.everything", 
              # "min.aic.fit", 
              "max.Accuracy.fit") else        
        glbMdlMetricsEval <- c("max.Accuracy.OOB", "max.Kappa.OOB", "min.elapsedtime.everything")
}

# select from NULL [no ensemble models], "auto" [all models better than MFO or Baseline], c(mdl_ids in glb_models_lst) [Typically top-rated models in auto]
glbMdlEnsemble <- "auto" # NULL : default #"auto"
#     "%<d-% setdiff(mygetEnsembleAutoMdlIds(), 'CSM.X.rf')" 
#     c(<comma-separated-mdlIds>
#      )
glbMdlEnsembleSampleMethods <- c("boot", "boot632", "cv", "repeatedcv"
               # , "LOOCV" # tuneLength * nrow(fitDF) # way too many models
               , "LGOCV"
               , "adaptive_cv" # crashed for Q109244No
               # , "adaptive_boot"  #error: adaptive$min should be less than 3
               # , "adaptive_LGOCV" #error: adaptive$min should be less than 3
               )


# Only for classifications; for regressions remove "(.*)\\.prob" form the regex
# tmp_fitobs_df <- glbObsFit[, grep(paste0("^", gsub(".", "\\.", mygetPredictIds$value, fixed = TRUE), "CSM\\.X\\.(.*)\\.prob"), names(glbObsFit), value = TRUE)]; cor_mtrx <- cor(tmp_fitobs_df); cor_vctr <- sort(cor_mtrx[row.names(orderBy(~-Overall, varImp(glb_models_lst[["Ensemble.repeatedcv.glmnet"]])$imp))[1], ]); summary(cor_vctr); cor_vctr
#ntv.glm <- glm(reformulate(indepVar, glb_rsp_var), family = "binomial", data = glbObsFit)
#step.glm <- step(ntv.glm)

glbMdlSelId <- NULL #select from c(NULL, "All.X##rcv#glmnet", "RFE.X##rcv#glmnet", <mdlId>)
glbMdlFinId <- NULL #select from c(NULL, glbMdlSelId)

glb_dsp_cols <- c(".pos", glbFeatsId, glbFeatsCategory, glb_rsp_var
#               List critical cols excl. above
                  )

# Output specs
# lclgetfltout_df <- function(obsOutFinDf) {
#     require(tidyr)
#     obsOutFinDf <- obsOutFinDf %>%
#         tidyr::separate("ImageId.x.y", c(".src", ".pos", "x", "y"), 
#                         sep = "#", remove = TRUE, extra = "merge")
#     # mnm prefix stands for max_n_mean
#     mnmout_df <- obsOutFinDf %>%
#         dplyr::group_by(.pos) %>%
#         #dplyr::top_n(1, Probability1) %>% # Score = 3.9426         
#         #dplyr::top_n(2, Probability1) %>% # Score = ???; weighted = 3.94254;         
#         #dplyr::top_n(3, Probability1) %>% # Score = 3.9418; weighted = 3.94169; 
#         dplyr::top_n(4, Probability1) %>% # Score = ???; weighted = 3.94149;        
#         #dplyr::top_n(5, Probability1) %>% # Score = 3.9421; weighted = 3.94178
#     
#         # dplyr::summarize(xMeanN = mean(as.numeric(x)), yMeanN = mean(as.numeric(y)))
#         # dplyr::summarize(xMeanN = weighted.mean(as.numeric(x), Probability1), yMeanN = mean(as.numeric(y)))
#         # dplyr::summarize(xMeanN = weighted.mean(as.numeric(x), c(Probability1, 0.2357323, 0.2336925)), yMeanN = mean(as.numeric(y)))    
#         # dplyr::summarize(xMeanN = weighted.mean(as.numeric(x), c(Probability1)), yMeanN = mean(as.numeric(y)))
#         dplyr::summarize(xMeanN = weighted.mean(as.numeric(x), c(Probability1)), 
#                          yMeanN = weighted.mean(as.numeric(y), c(Probability1)))  
#     
#     maxout_df <- obsOutFinDf %>%
#         dplyr::group_by(.pos) %>%
#         dplyr::summarize(maxProb1 = max(Probability1))
#     fltout_df <- merge(maxout_df, obsOutFinDf, 
#                        by.x = c(".pos", "maxProb1"), by.y = c(".pos", "Probability1"),
#                        all.x = TRUE)
#     fmnout_df <- merge(fltout_df, mnmout_df, 
#                        by.x = c(".pos"), by.y = c(".pos"),
#                        all.x = TRUE)
#     return(fmnout_df)
# }
glbObsOut <- list(NULL
        # glbFeatsId will be the first output column, by default
        ,vars = list()
#         ,mapFn = function(obsOutFinDf) {
#                   }
                  )
#obsOutFinDf <- savobsOutFinDf
# glbObsOut$mapFn <- function(obsOutFinDf) {
#     txfout_df <- dplyr::select(obsOutFinDf, -.pos.y) %>%
#         dplyr::mutate(
#             lunch     = levels(glbObsTrn[, "lunch"    ])[
#                        round(mean(as.numeric(glbObsTrn[, "lunch"    ])), 0)],
#             dinner    = levels(glbObsTrn[, "dinner"   ])[
#                        round(mean(as.numeric(glbObsTrn[, "dinner"   ])), 0)],
#             reserve   = levels(glbObsTrn[, "reserve"  ])[
#                        round(mean(as.numeric(glbObsTrn[, "reserve"  ])), 0)],
#             outdoor   = levels(glbObsTrn[, "outdoor"  ])[
#                        round(mean(as.numeric(glbObsTrn[, "outdoor"  ])), 0)],
#             expensive = levels(glbObsTrn[, "expensive"])[
#                        round(mean(as.numeric(glbObsTrn[, "expensive"])), 0)],
#             liquor    = levels(glbObsTrn[, "liquor"   ])[
#                        round(mean(as.numeric(glbObsTrn[, "liquor"   ])), 0)],
#             table     = levels(glbObsTrn[, "table"    ])[
#                        round(mean(as.numeric(glbObsTrn[, "table"    ])), 0)],
#             classy    = levels(glbObsTrn[, "classy"   ])[
#                        round(mean(as.numeric(glbObsTrn[, "classy"   ])), 0)],
#             kids      = levels(glbObsTrn[, "kids"     ])[
#                        round(mean(as.numeric(glbObsTrn[, "kids"     ])), 0)]
#                       )
#     
#     print("ObsNew output class tables:")
#     print(sapply(c("lunch","dinner","reserve","outdoor",
#                    "expensive","liquor","table",
#                    "classy","kids"), 
#                  function(feat) table(txfout_df[, feat], useNA = "ifany")))
#     
#     txfout_df <- txfout_df %>%
#         dplyr::mutate(labels = "") %>%
#         dplyr::mutate(labels = 
#     ifelse(lunch     != "-1", paste(labels, lunch    ), labels)) %>%
#         dplyr::mutate(labels = 
#     ifelse(dinner    != "-1", paste(labels, dinner   ), labels)) %>%
#         dplyr::mutate(labels = 
#     ifelse(reserve   != "-1", paste(labels, reserve  ), labels)) %>%
#         dplyr::mutate(labels = 
#     ifelse(outdoor   != "-1", paste(labels, outdoor  ), labels)) %>%
#         dplyr::mutate(labels =         
#     ifelse(expensive != "-1", paste(labels, expensive), labels)) %>%
#         dplyr::mutate(labels =         
#     ifelse(liquor    != "-1", paste(labels, liquor   ), labels)) %>%
#         dplyr::mutate(labels =         
#     ifelse(table     != "-1", paste(labels, table    ), labels)) %>%
#         dplyr::mutate(labels =         
#     ifelse(classy    != "-1", paste(labels, classy   ), labels)) %>%
#         dplyr::mutate(labels =         
#     ifelse(kids      != "-1", paste(labels, kids     ), labels)) %>%
#         dplyr::select(business_id, labels)
#     return(txfout_df)
# }
#if (!is.null(glbObsOut$mapFn)) obsOutFinDf <- glbObsOut$mapFn(obsOutFinDf); print(head(obsOutFinDf))

glb_out_obs <- NULL # select from c(NULL : default to "new", "all", "new", "trn")

if (glb_is_classification && glb_is_binomial) {
    # glbObsOut$vars[["Probability1"]] <- 
    #     "%<d-% glbObsNew[, mygetPredictIds(glb_rsp_var, glbMdlFinId)$prob]" 
    # glbObsOut$vars[[glb_rsp_var_raw]] <-
    #     "%<d-% glb_map_rsp_var_to_raw(glbObsNew[,
    #                                         mygetPredictIds(glb_rsp_var, glbMdlFinId)$value])"
    glbObsOut$vars[["Predictions"]] <-
        "%<d-% glb_map_rsp_var_to_raw(glbObsNew[,
                                            mygetPredictIds(glb_rsp_var, glbMdlFinId)$value])"
} else {
#     glbObsOut$vars[[glbFeatsId]] <- 
#         "%<d-% as.integer(gsub('Test#', '', glbObsNew[, glbFeatsId]))"
    glbObsOut$vars[[glb_rsp_var]] <- 
        "%<d-% glbObsNew[, mygetPredictIds(glb_rsp_var, glbMdlFinId)$value]"
#     for (outVar in setdiff(glbFeatsExcludeLcl, glb_rsp_var_raw))
#         glbObsOut$vars[[outVar]] <- 
#             paste0("%<d-% mean(glbObsAll[, \"", outVar, "\"], na.rm = TRUE)")
}    
# glbObsOut$vars[[glb_rsp_var_raw]] <- glb_rsp_var_raw
# glbObsOut$vars[[paste0(head(unlist(strsplit(mygetPredictIds$value, "")), -1), collapse = "")]] <-

glbOutStackFnames <- # NULL #: default
    c("Q109244No_AllXpreProc_cnk03_rest_out_fin.csv") 
    # c("Votes_Ensemble_cnk06_out_fin.csv") 


glbOut <- list(pfx = "Q109244NA_Ensemble_cnk03_rest_")
# lclImageSampleSeed <- 129
glbOutDataVizFname <- NULL # choose from c(NULL, "<projectId>_obsall.csv")


glbChunks <- list(labels = c("set_global_options_wd","set_global_options"
    ,"import.data","inspect.data","scrub.data","transform.data"
    ,"extract.features"
        ,"extract.features.datetime","extract.features.image","extract.features.price"
        ,"extract.features.text","extract.features.string"  
        ,"extract.features.end"
    ,"manage.missing.data","cluster.data","partition.data.training","select.features"
    ,"fit.models_0","fit.models_1","fit.models_2","fit.models_3"
    ,"fit.data.training_0","fit.data.training_1"
    ,"predict.data.new"         
    ,"display.session.info"))
# To ensure that all chunks in this script are in glbChunks
if (!is.null(chkChunksLabels <- knitr::all_labels()) && # knitr::all_labels() doesn't work in console runs
    !identical(chkChunksLabels, glbChunks$labels)) {
    print(sprintf("setdiff(chkChunksLabels, glbChunks$labels): %s", 
                  setdiff(chkChunksLabels, glbChunks$labels)))    
    print(sprintf("setdiff(glbChunks$labels, chkChunksLabels): %s", 
                  setdiff(glbChunks$labels, chkChunksLabels)))    
}

glbChunks[["first"]] <- "fit.models_2" # NULL # default: script will load envir from previous chunk
glbChunks[["last" ]] <- NULL # default: script will save envir at end of this chunk 
glbChunks[["inpFilePathName"]] <- "data/Q109244NA_Ensemble_Prep_fit.models_1_fit.models_1.RData" # NULL: default or "data/<prvScriptName>_<lstChunkLbl>.RData"
#mysavChunk(glbOut$pfx, glbChunks[["last"]]) # called from myevlChunk
# Temporary: Delete this function (if any) from here after appropriate .RData file is saved

# Inspect max OOB FP
#chkObsOOB <- subset(glbObsOOB, !label.fctr.All.X..rcv.glmnet.is.acc)
#chkObsOOBFP <- subset(chkObsOOB, label.fctr.All.X..rcv.glmnet == "left_eye_center") %>% dplyr::mutate(Probability1 = label.fctr.All.X..rcv.glmnet.prob) %>% select(-.src, -.pos, -x, -y) %>% lclgetfltout_df() %>% mutate(obj.distance = (((as.numeric(x) - left_eye_center_x.int) ^ 2) + ((as.numeric(y) - left_eye_center_y.int) ^ 2)) ^ 0.5) %>% dplyr::top_n(5, obj.distance) %>% dplyr::top_n(5, -patch.cor)
#
#newImgObs <- glbObsNew[(glbObsNew$ImageId == "Test#0001"), ]; print(newImgObs[which.max(newImgObs$label.fctr.Final..rcv.glmnet.prob), ])
#OOBImgObs <- glbObsOOB[(glbObsOOB$ImageId == "Train#0003"), ]; print(OOBImgObs[which.max(OOBImgObs$label.fctr.All.X..rcv.glmnet.prob), ])

#mygetImage(which(glbObsAll[, glbFeatsId] == "Train#0003"), names(glbFeatsImage)[1], plot = TRUE, featHighlight = c("left_eye_center_x", "left_eye_center_y"), ovrlHighlight = c(66, 35))

# Depict process
glb_analytics_pn <- petrinet(name = "glb_analytics_pn",
                        trans_df = data.frame(id = 1:6,
    name = c("data.training.all","data.new",
           "model.selected","model.final",
           "data.training.all.prediction","data.new.prediction"),
    x=c(   -5,-5,-15,-25,-25,-35),
    y=c(   -5, 5,  0,  0, -5,  5)
                        ),
                        places_df=data.frame(id=1:4,
    name=c("bgn","fit.data.training.all","predict.data.new","end"),
    x=c(   -0,   -20,                    -30,               -40),
    y=c(    0,     0,                      0,                 0),
    M0=c(   3,     0,                      0,                 0)
                        ),
                        arcs_df = data.frame(
    begin = c("bgn","bgn","bgn",        
            "data.training.all","model.selected","fit.data.training.all",
            "fit.data.training.all","model.final",    
            "data.new","predict.data.new",
            "data.training.all.prediction","data.new.prediction"),
    end   = c("data.training.all","data.new","model.selected",
            "fit.data.training.all","fit.data.training.all","model.final",
            "data.training.all.prediction","predict.data.new",
            "predict.data.new","data.new.prediction",
            "end","end")
                        ))
#print(ggplot.petrinet(glb_analytics_pn))
print(ggplot.petrinet(glb_analytics_pn) + coord_flip())
## Loading required package: grid

glb_analytics_avl_objs <- NULL

glb_chunks_df <- myadd_chunk(NULL, 
                             ifelse(is.null(glbChunks$first), "import.data", glbChunks$first))
##          label step_major step_minor label_minor   bgn end elapsed
## 1 fit.models_2          1          0           0 9.814  NA      NA

Step 1.0: fit models_2

chunk option: eval=

Step 1.0: fit models_2

Step 1.0: fit models_2

```{r scrub.data, cache=FALSE, echo=FALSE, eval=myevlChunk(glbChunks, glbOut$pfx)}

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

```{r extract.features.image, cache=FALSE, echo=FALSE, fig.height=5, fig.width=5, eval=myevlChunk(glbChunks, glbOut$pfx)}

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

```{r cluster.data, cache=FALSE, echo=FALSE, eval=myevlChunk(glbChunks, glbOut$pfx)}

Step 1.0: fit models_2

Step 1.0: fit models_2

```{r select.features, cache=FALSE, echo=FALSE, eval=myevlChunk(glbChunks, glbOut$pfx)}

Step 1.0: fit models_2

fit.models_0_chunk_df <- myadd_chunk(NULL, "fit.models_0_bgn", label.minor = "setup")
# load(paste0(glbOut$pfx, "dsk.RData"))

glbgetModelSelectFormula <- function() {
    model_evl_terms <- c(NULL)
    # min.aic.fit might not be avl
    lclMdlEvlCriteria <- 
        glbMdlMetricsEval[glbMdlMetricsEval %in% names(glb_models_df)]
    for (metric in lclMdlEvlCriteria)
        model_evl_terms <- c(model_evl_terms, 
                             ifelse(length(grep("max", metric)) > 0, "-", "+"), metric)
    if (glb_is_classification && glb_is_binomial)
        model_evl_terms <- c(model_evl_terms, "-", "opt.prob.threshold.OOB")
    model_sel_frmla <- as.formula(paste(c("~ ", model_evl_terms), collapse = " "))
    return(model_sel_frmla)
}

glbgetDisplayModelsDf <- function() {
    dsp_models_cols <- c("id", 
                    glbMdlMetricsEval[glbMdlMetricsEval %in% names(glb_models_df)],
                    grep("opt.", names(glb_models_df), fixed = TRUE, value = TRUE)) 
    dsp_models_df <- 
        #orderBy(glbgetModelSelectFormula(), glb_models_df)[, c("id", glbMdlMetricsEval)]
        orderBy(glbgetModelSelectFormula(), glb_models_df)[, dsp_models_cols]    
    nCvMdl <- sapply(glb_models_lst, function(mdl) nrow(mdl$results))
    nParams <- sapply(glb_models_lst, function(mdl) ifelse(mdl$method == "custom", 0, 
        nrow(subset(modelLookup(mdl$method), parameter != "parameter"))))
    
#     nCvMdl <- nCvMdl[names(nCvMdl) != "avNNet"]
#     nParams <- nParams[names(nParams) != "avNNet"]    
    
    if (length(cvMdlProblems <- nCvMdl[nCvMdl <= nParams]) > 0) {
        print("Cross Validation issues:")
        warning("Cross Validation issues:")        
        print(cvMdlProblems)
    }
    
    pltMdls <- setdiff(names(nCvMdl), names(cvMdlProblems))
    pltMdls <- setdiff(pltMdls, names(nParams[nParams == 0]))
    
    # length(pltMdls) == 21
    png(paste0(glbOut$pfx, "bestTune.png"), width = 480 * 2, height = 480 * 4)
    grid.newpage()
    pushViewport(viewport(layout = grid.layout(ceiling(length(pltMdls) / 2.0), 2)))
    pltIx <- 1
    for (mdlId in pltMdls) {
        print(ggplot(glb_models_lst[[mdlId]], highBestTune = TRUE) + labs(title = mdlId),   
              vp = viewport(layout.pos.row = ceiling(pltIx / 2.0), 
                            layout.pos.col = ((pltIx - 1) %% 2) + 1))  
        pltIx <- pltIx + 1
    }
    dev.off()

    if (all(row.names(dsp_models_df) != dsp_models_df$id))
        row.names(dsp_models_df) <- dsp_models_df$id
    return(dsp_models_df)
}
#glbgetDisplayModelsDf()

glb_get_predictions <- function(df, mdl_id, rsp_var, prob_threshold_def=NULL, verbose=FALSE) {
    mdl <- glb_models_lst[[mdl_id]]
    
    clmnNames <- mygetPredictIds(rsp_var, mdl_id)
    predct_var_name <- clmnNames$value        
    predct_prob_var_name <- clmnNames$prob
    predct_accurate_var_name <- clmnNames$is.acc
    predct_error_var_name <- clmnNames$err
    predct_erabs_var_name <- clmnNames$err.abs

    if (glb_is_regression) {
        df[, predct_var_name] <- predict(mdl, newdata=df, type="raw")
        if (verbose) print(myplot_scatter(df, glb_rsp_var, predct_var_name) + 
                  facet_wrap(reformulate(glbFeatsCategory), scales = "free") + 
                  stat_smooth(method="glm"))

        df[, predct_error_var_name] <- df[, predct_var_name] - df[, glb_rsp_var]
        if (verbose) print(myplot_scatter(df, predct_var_name, predct_error_var_name) + 
                  #facet_wrap(reformulate(glbFeatsCategory), scales = "free") + 
                  stat_smooth(method="auto"))
        if (verbose) print(myplot_scatter(df, glb_rsp_var, predct_error_var_name) + 
                  #facet_wrap(reformulate(glbFeatsCategory), scales = "free") + 
                  stat_smooth(method="glm"))
        
        df[, predct_erabs_var_name] <- abs(df[, predct_error_var_name])
        if (verbose) print(head(orderBy(reformulate(c("-", predct_erabs_var_name)), df)))
        
        df[, predct_accurate_var_name] <- (df[, glb_rsp_var] == df[, predct_var_name])
    }

    if (glb_is_classification && glb_is_binomial) {
        prob_threshold <- glb_models_df[glb_models_df$id == mdl_id, 
                                        "opt.prob.threshold.OOB"]
        if (is.null(prob_threshold) || is.na(prob_threshold)) {
            warning("Using default probability threshold: ", prob_threshold_def)
            if (is.null(prob_threshold <- prob_threshold_def))
                stop("Default probability threshold is NULL")
        }
        
        df[, predct_prob_var_name] <- predict(mdl, newdata = df, type = "prob")[, 2]
        df[, predct_var_name] <- 
                factor(levels(df[, glb_rsp_var])[
                    (df[, predct_prob_var_name] >=
                        prob_threshold) * 1 + 1], levels(df[, glb_rsp_var]))
    
#         if (verbose) print(myplot_scatter(df, glb_rsp_var, predct_var_name) + 
#                   facet_wrap(reformulate(glbFeatsCategory), scales = "free") + 
#                   stat_smooth(method="glm"))

        df[, predct_error_var_name] <- df[, predct_var_name] != df[, glb_rsp_var]
#         if (verbose) print(myplot_scatter(df, predct_var_name, predct_error_var_name) + 
#                   #facet_wrap(reformulate(glbFeatsCategory), scales = "free") + 
#                   stat_smooth(method="auto"))
#         if (verbose) print(myplot_scatter(df, glb_rsp_var, predct_error_var_name) + 
#                   #facet_wrap(reformulate(glbFeatsCategory), scales = "free") + 
#                   stat_smooth(method="glm"))
        
        # if prediction is a TP (true +ve), measure distance from 1.0
        tp <- which((df[, predct_var_name] == df[, glb_rsp_var]) &
                    (df[, predct_var_name] == levels(df[, glb_rsp_var])[2]))
        df[tp, predct_erabs_var_name] <- abs(1 - df[tp, predct_prob_var_name])
        #rowIx <- which.max(df[tp, predct_erabs_var_name]); df[tp, c(glbFeatsId, glb_rsp_var, predct_var_name, predct_prob_var_name, predct_erabs_var_name)][rowIx, ]
        
        # if prediction is a TN (true -ve), measure distance from 0.0
        tn <- which((df[, predct_var_name] == df[, glb_rsp_var]) &
                    (df[, predct_var_name] == levels(df[, glb_rsp_var])[1]))
        df[tn, predct_erabs_var_name] <- abs(0 - df[tn, predct_prob_var_name])
        #rowIx <- which.max(df[tn, predct_erabs_var_name]); df[tn, c(glbFeatsId, glb_rsp_var, predct_var_name, predct_prob_var_name, predct_erabs_var_name)][rowIx, ]
        
        # if prediction is a FP (flse +ve), measure distance from 0.0
        fp <- which((df[, predct_var_name] != df[, glb_rsp_var]) &
                    (df[, predct_var_name] == levels(df[, glb_rsp_var])[2]))
        df[fp, predct_erabs_var_name] <- abs(0 - df[fp, predct_prob_var_name])
        #rowIx <- which.max(df[fp, predct_erabs_var_name]); df[fp, c(glbFeatsId, glb_rsp_var, predct_var_name, predct_prob_var_name, predct_erabs_var_name)][rowIx, ]
        
        # if prediction is a FN (flse -ve), measure distance from 1.0
        fn <- which((df[, predct_var_name] != df[, glb_rsp_var]) &
                    (df[, predct_var_name] == levels(df[, glb_rsp_var])[1]))
        df[fn, predct_erabs_var_name] <- abs(1 - df[fn, predct_prob_var_name])
        #rowIx <- which.max(df[fn, predct_erabs_var_name]); df[fn, c(glbFeatsId, glb_rsp_var, predct_var_name, predct_prob_var_name, predct_erabs_var_name)][rowIx, ]

        
        if (verbose) print(head(orderBy(reformulate(c("-", predct_erabs_var_name)), df)))
        
        df[, predct_accurate_var_name] <- (df[, glb_rsp_var] == df[, predct_var_name])
    }    
    
    if (glb_is_classification && !glb_is_binomial) {
        df[, predct_var_name] <- predict(mdl, newdata = df, type = "raw")
        probCls <- predict(mdl, newdata = df, type = "prob")        
        df[, predct_prob_var_name] <- NA
        for (cls in names(probCls)) {
            mask <- (df[, predct_var_name] == cls)
            df[mask, predct_prob_var_name] <- probCls[mask, cls]
        }    
        if (verbose) print(myplot_histogram(df, predct_prob_var_name, 
                                            fill_col_name = predct_var_name))
        if (verbose) print(myplot_histogram(df, predct_prob_var_name, 
                                            facet_frmla = paste0("~", glb_rsp_var)))
        
        df[, predct_error_var_name] <- df[, predct_var_name] != df[, glb_rsp_var]
        
        # if prediction is erroneous, measure predicted class prob from actual class prob
        df[, predct_erabs_var_name] <- 0
        for (cls in names(probCls)) {
            mask <- (df[, glb_rsp_var] == cls) & (df[, predct_error_var_name])
            df[mask, predct_erabs_var_name] <- probCls[mask, cls]
        }    

        df[, predct_accurate_var_name] <- (df[, glb_rsp_var] == df[, predct_var_name])        
    }

    return(df)
}    

if (glb_is_classification && glb_is_binomial && 
        (length(unique(glbObsFit[, glb_rsp_var])) < 2))
    stop("glbObsFit$", glb_rsp_var, ": contains less than 2 unique values: ",
         paste0(unique(glbObsFit[, glb_rsp_var]), collapse=", "))

max_cor_y_x_vars <- orderBy(~ -cor.y.abs, 
        subset(glb_feats_df, (exclude.as.feat == 0) & !nzv & !is.cor.y.abs.low & 
                                is.na(cor.high.X)))[1:2, "id"]
max_cor_y_x_vars <- max_cor_y_x_vars[!is.na(max_cor_y_x_vars)]
if (length(max_cor_y_x_vars) < 2)
    max_cor_y_x_vars <- union(max_cor_y_x_vars, ".pos")

if (!is.null(glb_Baseline_mdl_var)) {
    if ((max_cor_y_x_vars[1] != glb_Baseline_mdl_var) & 
        (glb_feats_df[glb_feats_df$id == max_cor_y_x_vars[1], "cor.y.abs"] > 
         glb_feats_df[glb_feats_df$id == glb_Baseline_mdl_var, "cor.y.abs"]))
        stop(max_cor_y_x_vars[1], " has a higher correlation with ", glb_rsp_var, 
             " than the Baseline var: ", glb_Baseline_mdl_var)
}

glb_model_type <- ifelse(glb_is_regression, "regression", "classification")
    
# Model specs
# c("id.prefix", "method", "type",
#   # trainControl params
#   "preProc.method", "cv.n.folds", "cv.n.repeats", "summary.fn",
#   # train params
#   "metric", "metric.maximize", "tune.df")

# Baseline
if (!is.null(glb_Baseline_mdl_var)) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                            paste0("fit.models_0_", "Baseline"), major.inc = FALSE,
                                    label.minor = "mybaseln_classfr")
    ret_lst <- myfit_mdl(mdl_id="Baseline", 
                         model_method="mybaseln_classfr",
                        indepVar=glb_Baseline_mdl_var,
                        rsp_var=glb_rsp_var,
                        fit_df=glbObsFit, OOB_df=glbObsOOB)
}    

# Most Frequent Outcome "MFO" model: mean(y) for regression
#   Not using caret's nullModel since model stats not avl
#   Cannot use rpart for multinomial classification since it predicts non-MFO
if (glb_is_classification) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                                paste0("fit.models_0_", "MFO"), major.inc = FALSE,
                                        label.minor = "myMFO_classfr")

    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "MFO", type = glb_model_type, trainControl.method = "none",
        train.method = ifelse(glb_is_regression, "lm", "myMFO_classfr"))),
                            indepVar = ".rnorm", rsp_var = glb_rsp_var,
                            fit_df = glbObsFit, OOB_df = glbObsOOB)

        # "random" model - only for classification; 
        #   none needed for regression since it is same as MFO
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                                paste0("fit.models_0_", "Random"), major.inc = FALSE,
                                        label.minor = "myrandom_classfr")

#stop(here"); glb2Sav(); all.equal(glb_models_df, sav_models_df)    
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "Random", type = glb_model_type, trainControl.method = "none",
        train.method = "myrandom_classfr")),
                        indepVar = ".rnorm", rsp_var = glb_rsp_var,
                        fit_df = glbObsFit, OOB_df = glbObsOOB)
}

# Max.cor.Y
#   Check impact of cv
#       rpart is not a good candidate since caret does not optimize cp (only tuning parameter of rpart) well
fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                        paste0("fit.models_0_", "Max.cor.Y.rcv.*X*"), major.inc = FALSE,
                                    label.minor = "glmnet")

ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
    id.prefix = "Max.cor.Y.rcv.1X1", type = glb_model_type, trainControl.method = "none",
    train.method = "glmnet")),
                    indepVar = max_cor_y_x_vars, rsp_var = glb_rsp_var, 
                    fit_df = glbObsFit, OOB_df = glbObsOOB)

if (glbMdlCheckRcv) {
    # rcv_n_folds == 1 & rcv_n_repeats > 1 crashes
    for (rcv_n_folds in seq(3, glb_rcv_n_folds + 2, 2))
        for (rcv_n_repeats in seq(1, glb_rcv_n_repeats + 2, 2)) {
            
            # Experiment specific code to avoid caret crash
    #         lcl_tune_models_df <- rbind(data.frame()
    #                             ,data.frame(method = "glmnet", parameter = "alpha", 
    #                                         vals = "0.100 0.325 0.550 0.775 1.000")
    #                             ,data.frame(method = "glmnet", parameter = "lambda",
    #                                         vals = "9.342e-02")    
    #                                     )
            
            ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst =
                list(
                id.prefix = paste0("Max.cor.Y.rcv.", rcv_n_folds, "X", rcv_n_repeats), 
                type = glb_model_type, 
    # tune.df = lcl_tune_models_df,            
                trainControl.method = "repeatedcv",
                trainControl.number = rcv_n_folds, 
                trainControl.repeats = rcv_n_repeats,
                trainControl.classProbs = glb_is_classification,
                trainControl.summaryFunction = glbMdlMetricSummaryFn,
                train.method = "glmnet", train.metric = glbMdlMetricSummary, 
                train.maximize = glbMdlMetricMaximize)),
                                indepVar = max_cor_y_x_vars, rsp_var = glb_rsp_var, 
                                fit_df = glbObsFit, OOB_df = glbObsOOB)
        }
    # Add parallel coordinates graph of glb_models_df[, glbMdlMetricsEval] to evaluate cv parameters
    tmp_models_cols <- c("id", "max.nTuningRuns",
                        glbMdlMetricsEval[glbMdlMetricsEval %in% names(glb_models_df)],
                        grep("opt.", names(glb_models_df), fixed = TRUE, value = TRUE)) 
    print(myplot_parcoord(obs_df = subset(glb_models_df, 
                                          grepl("Max.cor.Y.rcv.", id, fixed = TRUE), 
                                            select = -feats)[, tmp_models_cols],
                          id_var = "id"))
}
        
# Useful for stacking decisions
# fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
#                     paste0("fit.models_0_", "Max.cor.Y[rcv.1X1.cp.0|]"), major.inc = FALSE,
#                                     label.minor = "rpart")
# 
# ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
#     id.prefix = "Max.cor.Y.rcv.1X1.cp.0", type = glb_model_type, trainControl.method = "none",
#     train.method = "rpart",
#     tune.df=data.frame(method="rpart", parameter="cp", min=0.0, max=0.0, by=0.1))),
#                     indepVar=max_cor_y_x_vars, rsp_var=glb_rsp_var, 
#                     fit_df=glbObsFit, OOB_df=glbObsOOB)

#stop(here"); glb2Sav(); all.equal(glb_models_df, sav_models_df)
# if (glb_is_regression || glb_is_binomial) # For multinomials this model will be run next by default
ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
                        id.prefix = "Max.cor.Y", 
                        type = glb_model_type, trainControl.method = "repeatedcv",
                        trainControl.number = glb_rcv_n_folds, 
                        trainControl.repeats = glb_rcv_n_repeats,
                        trainControl.classProbs = glb_is_classification,
                        trainControl.summaryFunction = glbMdlMetricSummaryFn,
                        trainControl.allowParallel = glbMdlAllowParallel,                        
                        train.metric = glbMdlMetricSummary, 
                        train.maximize = glbMdlMetricMaximize,    
                        train.method = "rpart")),
                    indepVar = max_cor_y_x_vars, rsp_var = glb_rsp_var, 
                    fit_df = glbObsFit, OOB_df = glbObsOOB)

if ((length(glbFeatsDateTime) > 0) && 
    (sum(grepl(paste(names(glbFeatsDateTime), "\\.day\\.minutes\\.poly\\.", sep = ""),
               names(glbObsAll))) > 0)) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                    paste0("fit.models_0_", "Max.cor.Y.Time.Poly"), major.inc = FALSE,
                                    label.minor = "glmnet")

    indepVars <- c(max_cor_y_x_vars, 
            grep(paste(names(glbFeatsDateTime), "\\.day\\.minutes\\.poly\\.", sep = ""),
                        names(glbObsAll), value = TRUE))
    indepVars <- myadjustInteractionFeats(glb_feats_df, indepVars)
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
            id.prefix = "Max.cor.Y.Time.Poly", 
            type = glb_model_type, trainControl.method = "repeatedcv",
            trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
            trainControl.classProbs = glb_is_classification,
            trainControl.summaryFunction = glbMdlMetricSummaryFn,
            trainControl.allowParallel = glbMdlAllowParallel,            
            train.metric = glbMdlMetricSummary, 
            train.maximize = glbMdlMetricMaximize,    
            train.method = "glmnet")),
        indepVar = indepVars,
        rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)
}

if ((length(glbFeatsDateTime) > 0) && 
    (sum(grepl(paste(names(glbFeatsDateTime), "\\.last[[:digit:]]", sep = ""),
               names(glbObsAll))) > 0)) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                    paste0("fit.models_0_", "Max.cor.Y.Time.Lag"), major.inc = FALSE,
                                    label.minor = "glmnet")

    indepVars <- c(max_cor_y_x_vars, 
            grep(paste(names(glbFeatsDateTime), "\\.last[[:digit:]]", sep = ""),
                        names(glbObsAll), value = TRUE))
    indepVars <- myadjustInteractionFeats(glb_feats_df, indepVars)
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "Max.cor.Y.Time.Lag", 
        type = glb_model_type, 
        tune.df = glbMdlTuneParams,        
        trainControl.method = "repeatedcv",
        trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        trainControl.allowParallel = glbMdlAllowParallel,        
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method = "glmnet")),
        indepVar = indepVars,
        rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)
}

if (length(glbFeatsText) > 0) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                    paste0("fit.models_0_", "Txt.*"), major.inc = FALSE,
                                    label.minor = "glmnet")

    indepVars <- c(max_cor_y_x_vars)
    for (txtFeat in names(glbFeatsText))
        indepVars <- union(indepVars, 
            grep(paste(str_to_upper(substr(txtFeat, 1, 1)), "\\.(?!([T|P]\\.))", sep = ""),
                        names(glbObsAll), perl = TRUE, value = TRUE))
    indepVars <- myadjustInteractionFeats(glb_feats_df, indepVars)
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "Max.cor.Y.Text.nonTP", 
        type = glb_model_type, 
        tune.df = glbMdlTuneParams,        
        trainControl.method = "repeatedcv",
        trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        trainControl.allowParallel = glbMdlAllowParallel,                                
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method = "glmnet")),
        indepVar = indepVars,
        rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)

    indepVars <- c(max_cor_y_x_vars)
    for (txtFeat in names(glbFeatsText))
        indepVars <- union(indepVars, 
            grep(paste(str_to_upper(substr(txtFeat, 1, 1)), "\\.T\\.", sep = ""),
                        names(glbObsAll), perl = TRUE, value = TRUE))
    indepVars <- myadjustInteractionFeats(glb_feats_df, indepVars)
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "Max.cor.Y.Text.onlyT", 
        type = glb_model_type, 
        tune.df = glbMdlTuneParams,        
        trainControl.method = "repeatedcv",
        trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method = "glmnet")),
        indepVar = indepVars,
        rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)

    indepVars <- c(max_cor_y_x_vars)
    for (txtFeat in names(glbFeatsText))
        indepVars <- union(indepVars, 
            grep(paste(str_to_upper(substr(txtFeat, 1, 1)), "\\.P\\.", sep = ""),
                        names(glbObsAll), perl = TRUE, value = TRUE))
    indepVars <- myadjustInteractionFeats(glb_feats_df, indepVars)
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "Max.cor.Y.Text.onlyP", 
        type = glb_model_type, 
        tune.df = glbMdlTuneParams,        
        trainControl.method = "repeatedcv",
        trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        trainControl.allowParallel = glbMdlAllowParallel,        
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method = "glmnet")),
        indepVar = indepVars,
        rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)
}

# Interactions.High.cor.Y
if (length(int_feats <- setdiff(setdiff(unique(glb_feats_df$cor.high.X), NA), 
                                subset(glb_feats_df, nzv)$id)) > 0) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                    paste0("fit.models_0_", "Interact.High.cor.Y"), major.inc = FALSE,
                                    label.minor = "glmnet")

    ret_lst <- myfit_mdl(mdl_specs_lst=myinit_mdl_specs_lst(mdl_specs_lst=list(
        id.prefix="Interact.High.cor.Y", 
        type=glb_model_type, trainControl.method="repeatedcv",
        trainControl.number=glb_rcv_n_folds, trainControl.repeats=glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        trainControl.allowParallel = glbMdlAllowParallel,
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method="glmnet")),
        indepVar=c(max_cor_y_x_vars, paste(max_cor_y_x_vars[1], int_feats, sep=":")),
        rsp_var=glb_rsp_var, 
        fit_df=glbObsFit, OOB_df=glbObsOOB)
}    

# Low.cor.X
fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                        paste0("fit.models_0_", "Low.cor.X"), major.inc = FALSE,
                                     label.minor = "glmnet")
indepVar <- mygetIndepVar(glb_feats_df)
indepVar <- setdiff(indepVar, unique(glb_feats_df$cor.high.X))
ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
            id.prefix = "Low.cor.X", 
            type = glb_model_type, 
            tune.df = glbMdlTuneParams,        
            trainControl.method = "repeatedcv",
            trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
            trainControl.classProbs = glb_is_classification,
            trainControl.summaryFunction = glbMdlMetricSummaryFn,
            trainControl.allowParallel = glbMdlAllowParallel,
            train.metric = glbMdlMetricSummary, 
            train.maximize = glbMdlMetricMaximize,    
            train.method = "glmnet")),
        indepVar = indepVar, rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)

fit.models_0_chunk_df <- 
    myadd_chunk(fit.models_0_chunk_df, "fit.models_0_end", major.inc = FALSE,
                label.minor = "teardown")

rm(ret_lst)

glb_chunks_df <- myadd_chunk(glb_chunks_df, "fit.models", major.inc = FALSE)

```{r fit.models_1, cache=FALSE, fig.height=10, fig.width=15, eval=myevlChunk(glbChunks, glbOut$pfx)}

```{r fit.models_2, cache=FALSE, fig.height=10, fig.width=15, eval=myevlChunk(glbChunks, glbOut$pfx)}

##              label step_major step_minor label_minor   bgn end elapsed
## 1 fit.models_2_bgn          1          0       setup 15.75  NA      NA
## Loading required package: reshape2
## Warning: max.AccuracyUpper.fit already exists in glb_models_df
## [1] "var:max.KappaSD.fit"
## Loading required package: RColorBrewer
## Warning: Removed 7 rows containing missing values (geom_errorbar).
## quartz_off_screen 
##                 2
## Warning: Removed 7 rows containing missing values (geom_errorbar).

##                                    id max.Accuracy.OOB max.AUCROCR.OOB
## 20            All.X#zv.pca#rcv#glmnet        0.6185102       0.6396502
## 19 All.X#zv.YeoJohnson.pca#rcv#glmnet        0.6049661       0.6418008
## 22        All.X#YeoJohnson#rcv#glmnet        0.6004515       0.6183995
## 11         All.X#expoTrans#rcv#glmnet        0.5981941       0.6183790
## 7                   All.X##rcv#glmnet        0.5981941       0.6177236
## 18      All.X#conditionalX#rcv#glmnet        0.5981941       0.6177236
## 8                 All.X#zv#rcv#glmnet        0.5981941       0.6177236
## 12            All.X#center#rcv#glmnet        0.5981941       0.6177236
## 13             All.X#scale#rcv#glmnet        0.5981941       0.6177236
## 14      All.X#center.scale#rcv#glmnet        0.5981941       0.6177236
## 10            All.X#BoxCox#rcv#glmnet        0.5981941       0.6177236
## 15             All.X#range#rcv#glmnet        0.5981941       0.6177031
## 28                     All.X##rcv#gbm        0.5981941       0.6071853
## 26                    All.X##rcv#nnet        0.5936795       0.6079329
## 31                   All.X##rcv#earth        0.5891648       0.6300131
## 25                All.X##rcv#bayesglm        0.5891648       0.6229569
## 21                     All.X##rcv#glm        0.5891648       0.6215845
## 24                All.X##rcv#bagEarth        0.5869074       0.6166482
## 9                All.X#nzv#rcv#glmnet        0.5869074       0.6160338
## 30                      All.X##rcv#rf        0.5846501       0.5972512
## 29                  All.X##rcv#avNNet        0.5846501       0.5963500
## 6               Low.cor.X##rcv#glmnet        0.5801354       0.6063250
## 23                  RFE.X##rcv#glmnet        0.5733634       0.5998013
## 5     Interact.High.cor.Y##rcv#glmnet        0.5733634       0.5847057
## 17       All.X#spatialSign#rcv#glmnet        0.5620767       0.5909631
## 27                   All.X##rcv#rpart        0.5530474       0.5700811
## 3          Max.cor.Y.rcv.1X1###glmnet        0.5485327       0.5505203
## 4                Max.cor.Y##rcv#rpart        0.5440181       0.5511143
## 16               All.X#ica#rcv#glmnet        0.5417607       0.5020483
## 2           Random###myrandom_classfr        0.5349887       0.5054791
## 1                 MFO###myMFO_classfr        0.5349887       0.5000000
##    max.AUCpROC.OOB min.elapsedtime.everything max.Accuracy.fit
## 20       0.6098275                     37.877        0.5690120
## 19       0.5909119                     92.648        0.5778312
## 22       0.5511245                     20.549        0.5739975
## 11       0.5511245                     41.608        0.5738059
## 7        0.5514420                      8.285        0.5764853
## 18       0.5514420                      9.076        0.5764853
## 8        0.5514420                      9.668        0.5764853
## 12       0.5514420                      9.949        0.5764853
## 13       0.5514420                      9.998        0.5764853
## 14       0.5514420                     11.201        0.5764853
## 10       0.5514420                     12.743        0.5764853
## 15       0.5514420                     10.244        0.5764853
## 28       0.5939945                     40.996        0.5805007
## 26       0.5793392                     51.376        0.5542802
## 31       0.5711769                     32.993        0.5596389
## 25       0.5647761                     18.802        0.5456648
## 21       0.5801790                     10.503        0.5462408
## 24       0.5831285                   1073.451        0.5401372
## 9        0.5493323                     12.237        0.5762963
## 30       0.5758470                     31.736        0.9994256
## 29       0.5765946                    103.553        0.5628910
## 6        0.5447954                      8.077        0.5764843
## 23       0.5496702                      2.464        0.5828137
## 5        0.5682479                      2.698        0.5540889
## 17       0.5453177                     14.076        0.5734181
## 27       0.5522306                      9.280        0.5466223
## 3        0.5471714                      0.796        0.5588742
## 4        0.5471714                      1.403        0.5588680
## 16       0.5072816                     21.649        0.5387702
## 2        0.5555897                      0.301        0.5364733
## 1        0.5000000                      0.455        0.5364733
##    opt.prob.threshold.fit opt.prob.threshold.OOB
## 20                   0.50                   0.45
## 19                   0.50                   0.45
## 22                   0.50                   0.45
## 11                   0.50                   0.45
## 7                    0.50                   0.45
## 18                   0.50                   0.45
## 8                    0.50                   0.45
## 12                   0.50                   0.45
## 13                   0.50                   0.45
## 14                   0.50                   0.45
## 10                   0.50                   0.45
## 15                   0.50                   0.45
## 28                   0.50                   0.50
## 26                   0.45                   0.30
## 31                   0.45                   0.55
## 25                   0.50                   0.45
## 21                   0.50                   0.45
## 24                   0.50                   0.50
## 9                    0.45                   0.45
## 30                   0.50                   0.55
## 29                   0.50                   0.55
## 6                    0.45                   0.45
## 23                   0.50                   0.45
## 5                    0.50                   0.50
## 17                   0.45                   0.50
## 27                   0.50                   0.55
## 3                    0.50                   0.55
## 4                    0.50                   0.50
## 16                   0.50                   0.50
## 2                    0.55                   0.55
## 1                    0.50                   0.50
## [1] "Metrics used for model selection:"
## ~-max.Accuracy.OOB - max.AUCROCR.OOB - max.AUCpROC.OOB + min.elapsedtime.everything - 
##     max.Accuracy.fit - opt.prob.threshold.OOB
## <environment: 0x7f84313e0590>
## [1] "Best model id: All.X#zv.pca#rcv#glmnet"
##                   label step_major step_minor label_minor    bgn    end
## 1      fit.models_2_bgn          1          0       setup 15.750 18.766
## 2 fit.models_2_Ensemble          2          0    ensemble 18.766     NA
##   elapsed
## 1   3.016
## 2      NA
## [1] "cor(Party.fctr.All.X..rcv.glmnet.prob, Party.fctr.All.X.BoxCox.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.glmnet.prob)=0.2749"
## [1] "cor(Party.fctr, Party.fctr.All.X.BoxCox.rcv.glmnet.prob)=0.2749"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X..rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.BoxCox.rcv.glmnet.prob, Party.fctr.All.X.center.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.BoxCox.rcv.glmnet.prob)=0.2749"
## [1] "cor(Party.fctr, Party.fctr.All.X.center.rcv.glmnet.prob)=0.2749"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.center.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.BoxCox.rcv.glmnet.prob, Party.fctr.All.X.center.scale.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.BoxCox.rcv.glmnet.prob)=0.2749"
## [1] "cor(Party.fctr, Party.fctr.All.X.center.scale.rcv.glmnet.prob)=0.2749"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.center.scale.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.BoxCox.rcv.glmnet.prob, Party.fctr.All.X.conditionalX.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.BoxCox.rcv.glmnet.prob)=0.2749"
## [1] "cor(Party.fctr, Party.fctr.All.X.conditionalX.rcv.glmnet.prob)=0.2749"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.conditionalX.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.BoxCox.rcv.glmnet.prob, Party.fctr.All.X.range.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.BoxCox.rcv.glmnet.prob)=0.2749"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.2749"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.BoxCox.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.All.X.scale.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.2749"
## [1] "cor(Party.fctr, Party.fctr.All.X.scale.rcv.glmnet.prob)=0.2749"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.scale.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.All.X.zv.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.2749"
## [1] "cor(Party.fctr, Party.fctr.All.X.zv.rcv.glmnet.prob)=0.2749"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.zv.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob)=0.2751"
## [1] "cor(Party.fctr, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.2751"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.expoTrans.rcv.glmnet.prob, Party.fctr.All.X.range.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.2751"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.2749"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.range.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X..rcv.bayesglm.prob, Party.fctr.All.X..rcv.glm.prob)=0.9989"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.bayesglm.prob)=0.4042"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.glm.prob)=0.4042"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X..rcv.glm.prob as highly
## correlated with Party.fctr.All.X..rcv.bayesglm.prob
## [1] "cor(Party.fctr.All.X.expoTrans.rcv.glmnet.prob, Party.fctr.Low.cor.X..rcv.glmnet.prob)=0.9946"
## [1] "cor(Party.fctr, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.2751"
## [1] "cor(Party.fctr, Party.fctr.Low.cor.X..rcv.glmnet.prob)=0.2677"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.Low.cor.X..rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.expoTrans.rcv.glmnet.prob, Party.fctr.All.X.nzv.rcv.glmnet.prob)=0.9924"
## [1] "cor(Party.fctr, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.2751"
## [1] "cor(Party.fctr, Party.fctr.All.X.nzv.rcv.glmnet.prob)=0.2693"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.nzv.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## [1] "cor(Party.fctr.Max.cor.Y..rcv.rpart.prob, Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob)=0.9649"
## [1] "cor(Party.fctr, Party.fctr.Max.cor.Y..rcv.rpart.prob)=0.1314"
## [1] "cor(Party.fctr, Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob)=0.1327"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.Max.cor.Y..rcv.rpart.prob as highly
## correlated with Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## [1] "cor(Party.fctr.All.X.expoTrans.rcv.glmnet.prob, Party.fctr.All.X.spatialSign.rcv.glmnet.prob)=0.9272"
## [1] "cor(Party.fctr, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.2751"
## [1] "cor(Party.fctr, Party.fctr.All.X.spatialSign.rcv.glmnet.prob)=0.2419"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.spatialSign.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X..rcv.bagEarth.prob, Party.fctr.All.X..rcv.bayesglm.prob)=0.9140"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.bagEarth.prob)=0.4049"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.bayesglm.prob)=0.4042"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X..rcv.bayesglm.prob as highly
## correlated with Party.fctr.All.X..rcv.bagEarth.prob
## [1] "cor(Party.fctr.All.X..rcv.bagEarth.prob, Party.fctr.All.X.zv.pca.rcv.glmnet.prob)=0.8912"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.bagEarth.prob)=0.4049"
## [1] "cor(Party.fctr, Party.fctr.All.X.zv.pca.rcv.glmnet.prob)=0.3680"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.zv.pca.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X..rcv.bagEarth.prob
## [1] "cor(Party.fctr.All.X..rcv.earth.prob, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.8834"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.earth.prob)=0.2658"
## [1] "cor(Party.fctr, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.2751"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X..rcv.earth.prob as highly
## correlated with Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X..rcv.bagEarth.prob, Party.fctr.All.X..rcv.gbm.prob)=0.8390"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.bagEarth.prob)=0.4049"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.gbm.prob)=0.4835"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X..rcv.bagEarth.prob as highly
## correlated with Party.fctr.All.X..rcv.gbm.prob
## [1] "cor(Party.fctr.All.X..rcv.avNNet.prob, Party.fctr.All.X..rcv.rf.prob)=0.8210"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.avNNet.prob)=0.7115"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.rf.prob)=0.8848"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X..rcv.avNNet.prob as highly
## correlated with Party.fctr.All.X..rcv.rf.prob
## [1] "cor(Party.fctr.All.X.expoTrans.rcv.glmnet.prob, Party.fctr.RFE.X..rcv.glmnet.prob)=0.8180"
## [1] "cor(Party.fctr, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.2751"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.glmnet.prob)=0.2246"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X..rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## [1] "cor(Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob, Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob)=0.7560"
## [1] "cor(Party.fctr, Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob)=0.1846"
## [1] "cor(Party.fctr, Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob)=0.1327"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob as
## highly correlated with Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X..rcv.gbm.prob, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.7449"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.gbm.prob)=0.4835"
## [1] "cor(Party.fctr, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.2751"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.expoTrans.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X..rcv.gbm.prob
## [1] "cor(Party.fctr.All.X..rcv.gbm.prob, Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob)=0.7028"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.gbm.prob)=0.4835"
## [1] "cor(Party.fctr, Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob)=0.3124"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## as highly correlated with Party.fctr.All.X..rcv.gbm.prob
## [1] "myfit_mdl: enter: 0.001000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.1##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm"
## [1] "myfit_mdl: setup complete: 0.656000 secs"
## Loading required package: glmnet
## Loading required package: Matrix
## Loaded glmnet 2.0-5
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.1, lambda = 0.00401 on full training set
## [1] "myfit_mdl: train complete: 2.797000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: alpha

##             Length Class      Mode     
## a0           70    -none-     numeric  
## beta        140    dgCMatrix  S4       
## df           70    -none-     numeric  
## dim           2    -none-     numeric  
## lambda       70    -none-     numeric  
## dev.ratio    70    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        2    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                             (Intercept) 
##                            -2.956562460 
##                                  .rnorm 
##                             0.003680609 
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                             6.014131897 
## [1] "max lambda < lambdaOpt:"
##                             (Intercept) 
##                            -2.963560909 
##                                  .rnorm 
##                             0.003766947 
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                             6.029024864 
## [1] "myfit_mdl: train diagnostics complete: 3.292000 secs"
## Loading required namespace: pROC
## Loading required package: ROCR
## Loading required package: gplots
## 
## Attaching package: 'gplots'
## The following object is masked from 'package:stats':
## 
##     lowess

## Loading required package: sqldf
## Loading required package: gsubfn
## Loading required package: proto
## Loading required package: RSQLite
## Loading required package: DBI
## Loading required package: tcltk

##          Prediction
## Reference   D   R
##         D 809 125
##         R 468 339
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   6.593912e-01   2.947589e-01   6.365885e-01   6.816553e-01   5.364733e-01 
## AccuracyPValue  McnemarPValue 
##   1.573605e-25   8.354027e-45

##          Prediction
## Reference   D   R
##         D 147  90
##         R  84 122
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##    0.607223476    0.212082183    0.560024928    0.652980193    0.534988713 
## AccuracyPValue  McnemarPValue 
##    0.001288291    0.704651461 
## [1] "myfit_mdl: predict complete: 13.029000 secs"
##                            id
## 1 Ensemble.auto.1##rcv#glmnet
##                                            feats max.nTuningRuns
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm              20
##   min.elapsedtime.everything min.elapsedtime.final max.AUCpROC.fit
## 1                      2.134                 0.022       0.6529723
##   max.Sens.fit max.Spec.fit max.AUCROCR.fit opt.prob.threshold.fit
## 1    0.7173448    0.5885998       0.7308853                    0.6
##   max.f.score.fit max.Accuracy.fit max.AccuracyLower.fit
## 1       0.5334382        0.6599656             0.6365885
##   max.AccuracyUpper.fit max.Kappa.fit max.AUCpROC.OOB max.Sens.OOB
## 1             0.6816553     0.3124477       0.6062431    0.6202532
##   max.Spec.OOB max.AUCROCR.OOB opt.prob.threshold.OOB max.f.score.OOB
## 1     0.592233       0.6397935                    0.5       0.5837321
##   max.Accuracy.OOB max.AccuracyLower.OOB max.AccuracyUpper.OOB
## 1        0.6072235             0.5600249             0.6529802
##   max.Kappa.OOB max.AccuracySD.fit max.KappaSD.fit
## 1     0.2120822         0.01856419       0.0371223
## [1] "myfit_mdl: exit: 13.110000 secs"
## glmnet variable importance
## 
##                                         Overall
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob     100
## .rnorm                                        0
##                                         Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                     0.4443496
##                                         Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.6716506
##                                         Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                       0.6342442
##                                         Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                      0.8082867
##                                         Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.89118
##                                         Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.8828277
##                                         Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                      0.8723863
##                                         Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       1
##                                         Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.8523558
##                                         Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.7254168
##                                         Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.7253686
##                                         Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.7254158
##                                         Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.7254158
##                                         Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7254158
##                                         Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.7254158
##                                         Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.7254158
##                                         Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.7254158
##                                         Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7254158
##                                         Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.7254158
##                                         Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.7123652
##                                         Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.7153233
##                                         Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                        0.6700651
##                                         Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.6308891
##                                         Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.5907518
##                                         Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                        0.4649697
##                                         Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3936072
##                                         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.3708695
##                                         Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.3538892
##                                         Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.06921113
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                         1.00000000 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                         0.89118004 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                         0.88282772 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                         0.87238630 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                         0.85235576 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                         0.80828671 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                         0.72541681 
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                         0.72541583 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                         0.72541583 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                         0.72541583 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                         0.72541583 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                         0.72541583 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                         0.72541583 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                         0.72541583 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                         0.72541583 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                         0.72536860 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                         0.71532332 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                         0.71236524 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                         0.67165059 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                         0.67006506 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                         0.63424421 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                         0.63088912 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                         0.59075182 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                         0.46496974 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                         0.44434961 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                         0.39360723 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                         0.37086950 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                         0.35388921 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                         0.06921113 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.2##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.697000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.00401 on full training set
## [1] "myfit_mdl: train complete: 2.620000 secs"

##             Length Class      Mode     
## a0           53    -none-     numeric  
## beta        159    dgCMatrix  S4       
## df           53    -none-     numeric  
## dim           2    -none-     numeric  
## lambda       53    -none-     numeric  
## dev.ratio    53    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        3    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                             (Intercept) 
##                               -3.482715 
##    Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                1.140275 
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                6.007640 
## [1] "max lambda < lambdaOpt:"
##                             (Intercept) 
##                               -3.516498 
##    Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                1.198098 
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                6.022408 
## [1] "myfit_mdl: train diagnostics complete: 3.213000 secs"

##          Prediction
## Reference   D   R
##         D 672 262
##         R 330 477
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   6.599655e-01   3.123536e-01   6.371710e-01   6.822196e-01   5.364733e-01 
## AccuracyPValue  McnemarPValue 
##   9.364589e-26   5.892881e-03

##          Prediction
## Reference   D   R
##         D 148  89
##         R  85 121
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##    0.607223476    0.211582522    0.560024928    0.652980193    0.534988713 
## AccuracyPValue  McnemarPValue 
##    0.001288291    0.820089851 
## [1] "myfit_mdl: predict complete: 10.924000 secs"
##                            id
## 1 Ensemble.auto.2##rcv#glmnet
##                                                                                 feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              20                      1.919                 0.017
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.6552821    0.7194861    0.5910781        0.730929
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5       0.6170763        0.6618823
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1              0.637171             0.6822196     0.3162352
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.6059256    0.6244726    0.5873786       0.6395682
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.5       0.5817308        0.6072235
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5600249             0.6529802     0.2115825
##   max.AccuracySD.fit max.KappaSD.fit
## 1         0.01960762      0.03947396
## [1] "myfit_mdl: exit: 10.999000 secs"
## glmnet variable importance
## 
##                                         Overall
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob  100.00
## Party.fctr.All.X.ica.rcv.glmnet.prob      19.43
## .rnorm                                     0.00
##                                         Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                    0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                       0.05594012
##                                         Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                        0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                           0.05918291
##                                         Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                      0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                         0.04892984
##                                         Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                      0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                         0.1036913
##                                         Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.1089841
##                                         Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                          0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.09599784
##                                         Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                     0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                        0.09460921
##                                         Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.06921113
##                                         Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          -0.009567133
##                                         Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.2237187
##                                         Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.2237432
##                                         Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.2238504
##                                         Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.2238504
##                                         Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.2238504
##                                         Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.2238504
##                                         Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.2238504
##                                         Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.2238504
##                                         Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.2238504
##                                         Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.2238504
##                                         Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.2192433
##                                         Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.2155047
##                                         Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                        0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                           0.1420945
##                                         Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2234457
##                                         Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                        0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                           0.03712174
##                                         Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                        0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                           0.1956013
##                                         Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.1475638
##                                         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.1080593
##                                         Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.2095866
##                                         Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.06921113
## Party.fctr.All.X.ica.rcv.glmnet.prob                              1.00000000
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.5346056 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.5346056 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.5000821 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.4894128 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.4834978 
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.4746331 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.4746331 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.4746331 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.4746331 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.4746331 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.4746331 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.4746331 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.4746331 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.4745678 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.4745559 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.4658043 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.4654140 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.4559890 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.4271674 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.4213943 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.4060798 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.3654168 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.3415870 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.3302855 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.3139368 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.2817379 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.2705855 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.2501449 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.2394644 
## [1] "myfit_mdl: enter: 0.001000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.3##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.698000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.775, lambda = 0.00401 on full training set
## [1] "myfit_mdl: train complete: 2.701000 secs"

##             Length Class      Mode     
## a0           50    -none-     numeric  
## beta        200    dgCMatrix  S4       
## df           50    -none-     numeric  
## dim           2    -none-     numeric  
## lambda       50    -none-     numeric  
## dev.ratio    50    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        4    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                             (Intercept) 
##                              -3.3340538 
##    Party.fctr.All.X.ica.rcv.glmnet.prob 
##                               0.8260004 
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                               6.0017708 
## [1] "max lambda < lambdaOpt:"
##                             (Intercept) 
##                              -3.3809618 
##    Party.fctr.All.X.ica.rcv.glmnet.prob 
##                               0.9115226 
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                               6.0171056 
## [1] "myfit_mdl: train diagnostics complete: 3.291000 secs"

##          Prediction
## Reference   D   R
##         D 672 262
##         R 329 478
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   6.605399e-01   3.135733e-01   6.377535e-01   6.827839e-01   5.364733e-01 
## AccuracyPValue  McnemarPValue 
##   5.558782e-26   6.630034e-03

##          Prediction
## Reference   D   R
##         D 148  89
##         R  85 121
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##    0.607223476    0.211582522    0.560024928    0.652980193    0.534988713 
## AccuracyPValue  McnemarPValue 
##    0.001288291    0.820089851 
## [1] "myfit_mdl: predict complete: 10.877000 secs"
##                            id
## 1 Ensemble.auto.3##rcv#glmnet
##                                                                                                                            feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              20                      1.997                 0.017
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.6559017    0.7194861    0.5923172       0.7309423
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5       0.6179703        0.6613076
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.6377535             0.6827839     0.3150177
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.6059256    0.6244726    0.5873786       0.6395887
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.5       0.5817308        0.6072235
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5600249             0.6529802     0.2115825
##   max.AccuracySD.fit max.KappaSD.fit
## 1         0.01884745      0.03784478
## [1] "myfit_mdl: exit: 10.958000 secs"
## glmnet variable importance
## 
##                                            Overall
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob     100.00
## Party.fctr.All.X.ica.rcv.glmnet.prob         14.87
## .rnorm                                        0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob    0.00
##                                            Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                       0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                          0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                    0.18691638
##                                            Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.29307602
##                                            Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                      0.22802575
##                                            Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                      0.3723600
##                                            Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.3953001
##                                            Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                          0.31711659
##                                            Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                        0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                           0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                     0.31052585
##                                            Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.37086950
##                                            Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                           0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                        0.380507275
##                                            Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.5228300
##                                            Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228501
##                                            Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.5228551
##                                            Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                               0.5228551
##                                            Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5228551
##                                            Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.5228551
##                                            Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                               0.5228551
##                                            Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.5228551
##                                            Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5228551
##                                            Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                         0.5228551
##                                            Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.5292805
##                                            Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.5252550
##                                            Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.4774014
##                                            Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5708480
##                                            Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.32079312
##                                            Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.6071103
##                                            Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.7560218
##                                            Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  1.0000000
##                                            Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.9648766
##                                            Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.06921113
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 1.00000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.10805925
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.5094508 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4929763 
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.4907071 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.4907071 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.4907071 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.4907071 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.4907071 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.4907071 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.4907071 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.4907071 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.4906552 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.4906539 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.4869630 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.4853610 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.4800269 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.4750609 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.4651548 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4323976 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.4319807 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.4298537 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.4281127 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.4258405 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4225604 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.4077653 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.3924235 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.3413032 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.3162222 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.3037333 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.2290687 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.4##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob"
## [1] "myfit_mdl: setup complete: 0.680000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.1, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.973000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: alpha
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0          100    -none-     numeric  
## beta        500    dgCMatrix  S4       
## df          100    -none-     numeric  
## dim           2    -none-     numeric  
## lambda      100    -none-     numeric  
## dev.ratio   100    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        5    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                             (Intercept) 
##                               -2.248000 
##           Party.fctr.All.X..rcv.rf.prob 
##                                3.277938 
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                1.157682 
## [1] "max lambda < lambdaOpt:"
##                             (Intercept) 
##                               -2.349206 
##           Party.fctr.All.X..rcv.rf.prob 
##                                3.457519 
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                1.188663 
## [1] "myfit_mdl: train diagnostics complete: 3.593000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256
## 12      0.55 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 161  76
##         R  97 109
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##    0.609480813    0.209850195    0.562313458    0.655175934    0.534988713 
## AccuracyPValue  McnemarPValue 
##    0.000933503    0.128367317 
## [1] "myfit_mdl: predict complete: 11.337000 secs"
##                            id
## 1 Ensemble.auto.4##rcv#glmnet
##                                                                                                                                                          feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.287                 0.039
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999987
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.6042256    0.6793249    0.5291262       0.6235304
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.5       0.5575448        0.6094808
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5623135             0.6551759     0.2098502
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.414000 secs"
## glmnet variable importance
## 
##                                            Overall
## Party.fctr.All.X..rcv.rf.prob               100.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob      34.55
## .rnorm                                        0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob          0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob    0.00
##                                            Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                       0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                          0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                    0.18691638
## Party.fctr.All.X..rcv.rf.prob                                 1.00000000
##                                            Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.29307602
## Party.fctr.All.X..rcv.rf.prob                                     0.82103138
##                                            Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                      0.22802575
## Party.fctr.All.X..rcv.rf.prob                                   0.58287547
##                                            Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                      0.3723600
## Party.fctr.All.X..rcv.rf.prob                                   0.5916906
##                                            Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.3953001
## Party.fctr.All.X..rcv.rf.prob                                        0.5006769
##                                            Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                          0.31711659
## Party.fctr.All.X..rcv.rf.prob                                       0.48425376
##                                            Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                        0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                           0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                     0.31052585
## Party.fctr.All.X..rcv.rf.prob                                  0.48341240
##                                            Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.37086950
## Party.fctr.All.X..rcv.rf.prob                                           0.44434961
##                                            Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                           0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                        0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                     0.376405358
##                                            Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.5228300
## Party.fctr.All.X..rcv.rf.prob                                               0.3622107
##                                            Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                0.3621894
##                                            Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.5228551
## Party.fctr.All.X..rcv.rf.prob                                           0.3622445
##                                            Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                               0.5228551
## Party.fctr.All.X..rcv.rf.prob                                            0.3622445
##                                            Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                  0.3622445
##                                            Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.5228551
## Party.fctr.All.X..rcv.rf.prob                                        0.3622445
##                                            Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                               0.5228551
## Party.fctr.All.X..rcv.rf.prob                                            0.3622445
##                                            Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.5228551
## Party.fctr.All.X..rcv.rf.prob                                           0.3622445
##                                            Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                  0.3622445
##                                            Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                         0.5228551
## Party.fctr.All.X..rcv.rf.prob                                      0.3622445
##                                            Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.5292805
## Party.fctr.All.X..rcv.rf.prob                                         0.3555789
##                                            Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.5252550
## Party.fctr.All.X..rcv.rf.prob                                          0.3569896
##                                            Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.4774014
## Party.fctr.All.X..rcv.rf.prob                                     0.3312323
##                                            Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                 0.3364487
##                                            Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.32079312
## Party.fctr.All.X..rcv.rf.prob                                     0.30485184
##                                            Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.6071103
## Party.fctr.All.X..rcv.rf.prob                                     0.2689975
##                                            Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                    0.2220613
##                                            Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  1.0000000
## Party.fctr.All.X..rcv.rf.prob                                               0.1869164
##                                            Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.9648766
## Party.fctr.All.X..rcv.rf.prob                                         0.1835510
##                                            Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.06921113
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 1.00000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.10805925
## Party.fctr.All.X..rcv.rf.prob                                        0.05594012
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.4740353 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.4711076 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.4690072 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.4612352 
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.4585915 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.4585915 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.4585915 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.4585915 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.4585915 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.4585915 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.4585915 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.4585915 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.4585441 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.4585378 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.4541170 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.4532682 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.4450490 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.4404079 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.4402334 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4279759 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4218015 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4164613 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.4051983 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.3999253 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.3841697 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.3798135 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.3735188 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.3133796 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.3083026 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.5##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.703000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.1, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.788000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: alpha

## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0          100    -none-     numeric  
## beta        600    dgCMatrix  S4       
## df          100    -none-     numeric  
## dim           2    -none-     numeric  
## lambda      100    -none-     numeric  
## dev.ratio   100    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        6    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                             (Intercept) 
##                              -2.3231739 
##           Party.fctr.All.X..rcv.rf.prob 
##                               3.2737318 
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                               1.1226230 
##       Party.fctr.RFE.X..rcv.glmnet.prob 
##                               0.2012458 
## [1] "max lambda < lambdaOpt:"
##                             (Intercept) 
##                              -2.4217710 
##           Party.fctr.All.X..rcv.rf.prob 
##                               3.4535165 
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                               1.1534973 
##       Party.fctr.RFE.X..rcv.glmnet.prob 
##                               0.1955345 
## [1] "myfit_mdl: train diagnostics complete: 3.406000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256
## 12      0.55 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 158  79
##         R  98 108
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##    0.600451467    0.192097264    0.553165390    0.646386898    0.534988713 
## AccuracyPValue  McnemarPValue 
##    0.003212337    0.176067499 
## [1] "myfit_mdl: predict complete: 11.154000 secs"
##                            id
## 1 Ensemble.auto.5##rcv#glmnet
##                                                                                                                                                                                            feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.078                 0.041
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999973
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5954693    0.6666667    0.5242718       0.6245955
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.5       0.5496183        0.6004515
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5531654             0.6463869     0.1920973
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.232000 secs"
## glmnet variable importance
## 
##                                            Overall
## Party.fctr.All.X..rcv.rf.prob              100.000
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob     33.565
## Party.fctr.RFE.X..rcv.glmnet.prob            5.752
## .rnorm                                       0.000
## Party.fctr.All.X.ica.rcv.glmnet.prob         0.000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob   0.000
##                                            Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                       0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                          0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                    0.18691638
## Party.fctr.All.X..rcv.rf.prob                                 1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                             0.30485184
##                                            Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.29307602
## Party.fctr.All.X..rcv.rf.prob                                     0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                 0.48686609
##                                            Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                      0.22802575
## Party.fctr.All.X..rcv.rf.prob                                   0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                               0.42139834
##                                            Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                      0.3723600
## Party.fctr.All.X..rcv.rf.prob                                   0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                               0.6257192
##                                            Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.3953001
## Party.fctr.All.X..rcv.rf.prob                                        0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.6248532
##                                            Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                          0.31711659
## Party.fctr.All.X..rcv.rf.prob                                       0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                   0.54200810
##                                            Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                        0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                           0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                     0.31052585
## Party.fctr.All.X..rcv.rf.prob                                  0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                              0.53232338
##                                            Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.37086950
## Party.fctr.All.X..rcv.rf.prob                                           0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.59075182
##                                            Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                           0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                        0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                     0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                 0.613182343
##                                            Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.5228300
## Party.fctr.All.X..rcv.rf.prob                                               0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.8180426
##                                            Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8179341
##                                            Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.5228551
## Party.fctr.All.X..rcv.rf.prob                                           0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.8180305
##                                            Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                               0.5228551
## Party.fctr.All.X..rcv.rf.prob                                            0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                        0.8180305
##                                            Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                  0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8180305
##                                            Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.5228551
## Party.fctr.All.X..rcv.rf.prob                                        0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.8180305
##                                            Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                               0.5228551
## Party.fctr.All.X..rcv.rf.prob                                            0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                        0.8180305
##                                            Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.5228551
## Party.fctr.All.X..rcv.rf.prob                                           0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.8180305
##                                            Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                  0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8180305
##                                            Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                         0.5228551
## Party.fctr.All.X..rcv.rf.prob                                      0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                  0.8180305
##                                            Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.5292805
## Party.fctr.All.X..rcv.rf.prob                                         0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.8241202
##                                            Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.5252550
## Party.fctr.All.X..rcv.rf.prob                                          0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.8209720
##                                            Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.4774014
## Party.fctr.All.X..rcv.rf.prob                                     0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                 0.6556800
##                                            Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                 0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.7602901
##                                            Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.32079312
## Party.fctr.All.X..rcv.rf.prob                                     0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                 1.00000000
##                                            Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                        0.6071103
## Party.fctr.All.X..rcv.rf.prob                                     0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                 0.5207209
##                                            Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                    0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.2727443
##                                            Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  1.0000000
## Party.fctr.All.X..rcv.rf.prob                                               0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.3207931
##                                            Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.9648766
## Party.fctr.All.X..rcv.rf.prob                                         0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.3082613
##                                            Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.06921113
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 1.00000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.10805925
## Party.fctr.All.X..rcv.rf.prob                                        0.05594012
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.03712174
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.5304793 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.5304793 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.5304793 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.5304793 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.5304793 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.5304793 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.5304793 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.5304793 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.5304438 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.5304171 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.5281176 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.5268089 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.5043843 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.5041989 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.5003496 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.4950364 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.4663614 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.4644408 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.4586514 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.4552947 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4507037 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.4425767 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4114799 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4040330 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3984116 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.3973277 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.3830947 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.3583997 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.2540664 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.6##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.688000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.1, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.855000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: alpha

## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0          100    -none-     numeric  
## beta        700    dgCMatrix  S4       
## df          100    -none-     numeric  
## dim           2    -none-     numeric  
## lambda      100    -none-     numeric  
## dev.ratio   100    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        7    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                                     (Intercept) 
##                                      -2.4147362 
##                   Party.fctr.All.X..rcv.rf.prob 
##                                       3.2704739 
##         Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                       1.1033155 
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                       0.2340248 
##               Party.fctr.RFE.X..rcv.glmnet.prob 
##                                       0.1865434 
## [1] "max lambda < lambdaOpt:"
##                                     (Intercept) 
##                                      -2.5179878 
##                   Party.fctr.All.X..rcv.rf.prob 
##                                       3.4500978 
##         Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                       1.1325554 
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                       0.2468211 
##               Party.fctr.RFE.X..rcv.glmnet.prob 
##                                       0.1797940 
## [1] "myfit_mdl: train diagnostics complete: 3.479000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256
## 12      0.55 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 190  47
##         R 129  77
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   6.027088e-01   1.801645e-01   5.554509e-01   6.485857e-01   5.349887e-01 
## AccuracyPValue  McnemarPValue 
##   2.389716e-03   1.024122e-09 
## [1] "myfit_mdl: predict complete: 11.215000 secs"
##                            id
## 1 Ensemble.auto.6##rcv#glmnet
##                                                                                                                                                                                                                                            feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                       2.16                 0.046
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999973
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5902974    0.6708861    0.5097087       0.6253328
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.55       0.4666667        0.6027088
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5554509             0.6485857     0.1801645
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.294000 secs"
## glmnet variable importance
## 
##                                                 Overall
## Party.fctr.All.X..rcv.rf.prob                   100.000
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob          32.995
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob   7.154
## Party.fctr.RFE.X..rcv.glmnet.prob                 5.302
## .rnorm                                            0.000
## Party.fctr.All.X.ica.rcv.glmnet.prob              0.000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob        0.000
##                                                 Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                         0.18691638
## Party.fctr.All.X..rcv.rf.prob                                      1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                  0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                    0.22206127
##                                                 Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.29307602
## Party.fctr.All.X..rcv.rf.prob                                          0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.31214569
##                                                 Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.22802575
## Party.fctr.All.X..rcv.rf.prob                                        0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                      0.26249036
##                                                 Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.3723600
## Party.fctr.All.X..rcv.rf.prob                                        0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                      0.3721555
##                                                 Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.3953001
## Party.fctr.All.X..rcv.rf.prob                                             0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4259955
##                                                 Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                               0.31711659
## Party.fctr.All.X..rcv.rf.prob                                            0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                        0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                          0.35293404
##                                                 Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                          0.31052585
## Party.fctr.All.X..rcv.rf.prob                                       0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                   0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                     0.34606011
##                                                 Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.39360723
##                                                 Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                          0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.381804540
##                                                 Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4751697
##                                                 Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                           0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                              0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                        0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                     0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                 0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                   0.4752093
##                                                 Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
##                                                 Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                 0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4752537
##                                                 Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4752537
##                                                 Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.5228551
## Party.fctr.All.X..rcv.rf.prob                                             0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4752537
##                                                 Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                 0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4752537
##                                                 Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
##                                                 Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4752537
##                                                 Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.5228551
## Party.fctr.All.X..rcv.rf.prob                                           0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.4752537
##                                                 Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5292805
## Party.fctr.All.X..rcv.rf.prob                                              0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4795723
##                                                 Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.5252550
## Party.fctr.All.X..rcv.rf.prob                                               0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.4366224
##                                                 Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.4774014
## Party.fctr.All.X..rcv.rf.prob                                          0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.4471574
##                                                 Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                            0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                         0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                      0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                  0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                    0.4687519
##                                                 Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.32079312
## Party.fctr.All.X..rcv.rf.prob                                          0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                      1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.27274431
##                                                 Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.6071103
## Party.fctr.All.X..rcv.rf.prob                                          0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.4863653
##                                                 Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                         0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       1.0000000
##                                                 Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                    0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.7560218
##                                                 Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.9648766
## Party.fctr.All.X..rcv.rf.prob                                              0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.7287406
##                                                 Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.06921113
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      1.00000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.10805925
## Party.fctr.All.X..rcv.rf.prob                                             0.05594012
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.03712174
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.14756379
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.5212750 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.5212750 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.5212750 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.5212750 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.5212750 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.5212750 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.5212750 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.5212750 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.5212314 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.5212158 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.5200267 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.5117778 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.4984456 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.4911650 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.4789839 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.4781315 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4653331 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4581509 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4571100 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.4539385 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.4458563 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.4406588 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.4398862 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.4324480 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4239608 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4210438 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3690199 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.3629940 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.2363160 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.7##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob"
## [1] "myfit_mdl: setup complete: 0.687000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.1, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.897000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: alpha

## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0          100    -none-     numeric  
## beta        800    dgCMatrix  S4       
## df          100    -none-     numeric  
## dim           2    -none-     numeric  
## lambda      100    -none-     numeric  
## dev.ratio   100    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        8    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                                     (Intercept) 
##                                     -2.42844592 
##                 Party.fctr.All.X..rcv.nnet.prob 
##                                      1.04444990 
##                   Party.fctr.All.X..rcv.rf.prob 
##                                      3.07568947 
##         Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                      0.66313975 
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                      0.02318591 
## [1] "max lambda < lambdaOpt:"
##                                     (Intercept) 
##                                     -2.52737770 
##                 Party.fctr.All.X..rcv.nnet.prob 
##                                      1.07296423 
##                   Party.fctr.All.X..rcv.rf.prob 
##                                      3.24631206 
##         Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                      0.66409214 
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                      0.02786074 
## [1] "myfit_mdl: train diagnostics complete: 3.496000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 171  66
##         R 109  97
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##    0.604966140    0.195055601    0.557737408    0.650783438    0.534988713 
## AccuracyPValue  McnemarPValue 
##    0.001762317    0.001498873 
## [1] "myfit_mdl: predict complete: 11.073000 secs"
##                            id
## 1 Ensemble.auto.7##rcv#glmnet
##                                                                                                                                                                                                                                                                            feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.203                 0.048
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5955819    0.6329114    0.5582524       0.6229978
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.55       0.5257453        0.6049661
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5577374             0.6507834     0.1950556
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.152000 secs"
## glmnet variable importance
## 
##                                                  Overall
## Party.fctr.All.X..rcv.rf.prob                   100.0000
## Party.fctr.All.X..rcv.nnet.prob                  33.2193
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob          20.6608
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob   0.8389
## .rnorm                                            0.0000
## Party.fctr.RFE.X..rcv.glmnet.prob                 0.0000
## Party.fctr.All.X.ica.rcv.glmnet.prob              0.0000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob        0.0000
##                                                 Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                         0.18691638
## Party.fctr.All.X..rcv.rf.prob                                      1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                  0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                    0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                    0.58287547
##                                                 Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.29307602
## Party.fctr.All.X..rcv.rf.prob                                          0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                        0.70883910
##                                                 Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.22802575
## Party.fctr.All.X..rcv.rf.prob                                        0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                      0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                      1.00000000
##                                                 Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.3723600
## Party.fctr.All.X..rcv.rf.prob                                        0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                      0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                      0.6521829
##                                                 Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.3953001
## Party.fctr.All.X..rcv.rf.prob                                             0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                           0.6533970
##                                                 Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                               0.31711659
## Party.fctr.All.X..rcv.rf.prob                                            0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                        0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                          0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                          0.69744545
##                                                 Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                          0.31052585
## Party.fctr.All.X..rcv.rf.prob                                       0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                   0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                     0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                     0.69504066
##                                                 Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                              0.63424421
##                                                 Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                          0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                        0.548834711
##                                                 Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5004671
##                                                 Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                           0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                              0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                        0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                     0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                 0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                   0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                   0.5004263
##                                                 Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
##                                                 Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                 0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                               0.5000854
##                                                 Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5000854
##                                                 Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.5228551
## Party.fctr.All.X..rcv.rf.prob                                             0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                           0.5000854
##                                                 Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                 0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                               0.5000854
##                                                 Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
##                                                 Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5000854
##                                                 Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.5228551
## Party.fctr.All.X..rcv.rf.prob                                           0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                         0.5000854
##                                                 Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5292805
## Party.fctr.All.X..rcv.rf.prob                                              0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                            0.4899012
##                                                 Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.5252550
## Party.fctr.All.X..rcv.rf.prob                                               0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                             0.4918954
##                                                 Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.4774014
## Party.fctr.All.X..rcv.rf.prob                                          0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                        0.4504827
##                                                 Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                            0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                         0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                      0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                  0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                    0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                    0.4474187
##                                                 Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.32079312
## Party.fctr.All.X..rcv.rf.prob                                          0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                      1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                        0.42139834
##                                                 Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.6071103
## Party.fctr.All.X..rcv.rf.prob                                          0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                        0.3410528
##                                                 Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                         0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                       0.2624904
##                                                 Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                    0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                  0.2280258
##                                                 Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.9648766
## Party.fctr.All.X..rcv.rf.prob                                              0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                            0.2211907
##                                                 Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.06921113
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      1.00000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.10805925
## Party.fctr.All.X..rcv.rf.prob                                             0.05594012
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.03712174
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.14756379
## Party.fctr.All.X..rcv.nnet.prob                                           0.04892984
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.5182651 
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.5182479 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.5182479 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.5182479 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.5182479 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.5182479 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.5182479 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.5182479 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.5182479 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.5182459 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.5157231 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.5143410 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.5089375 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.5037266 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.5004334 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.4911560 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.4817976 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.4789703 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.4763368 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4539949 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.4534448 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.4490747 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4363555 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4243837 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4242994 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4210945 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4121168 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3995707 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.2095466 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.8##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob"
## [1] "myfit_mdl: setup complete: 0.674000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.1, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.860000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: alpha

## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0          100    -none-     numeric  
## beta        900    dgCMatrix  S4       
## df          100    -none-     numeric  
## dim           2    -none-     numeric  
## lambda      100    -none-     numeric  
## dev.ratio   100    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        9    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                                     (Intercept) 
##                                     -2.43257913 
##                 Party.fctr.All.X..rcv.nnet.prob 
##                                      1.04408613 
##                   Party.fctr.All.X..rcv.rf.prob 
##                                      3.07552883 
##                Party.fctr.All.X..rcv.rpart.prob 
##                                      0.01388748 
##         Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                      0.66171681 
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                      0.02010406 
## [1] "max lambda < lambdaOpt:"
##                                     (Intercept) 
##                                    -2.530051398 
##                 Party.fctr.All.X..rcv.nnet.prob 
##                                     1.072728008 
##                   Party.fctr.All.X..rcv.rf.prob 
##                                     3.246212451 
##                Party.fctr.All.X..rcv.rpart.prob 
##                                     0.009106864 
##         Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                     0.663126140 
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                     0.025783892 
## [1] "myfit_mdl: train diagnostics complete: 3.475000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 170  67
##         R 109  97
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##    0.602708804    0.190716406    0.555450897    0.648585672    0.534988713 
## AccuracyPValue  McnemarPValue 
##    0.002389716    0.001998257 
## [1] "myfit_mdl: predict complete: 11.505000 secs"
##                            id
## 1 Ensemble.auto.8##rcv#glmnet
##                                                                                                                                                                                                                                                                                                             feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.178                  0.05
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5955819    0.6329114    0.5582524       0.6229773
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.55       0.5243243        0.6027088
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5554509             0.6485857     0.1907164
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.586000 secs"
## glmnet variable importance
## 
##                                                  Overall
## Party.fctr.All.X..rcv.rf.prob                   100.0000
## Party.fctr.All.X..rcv.nnet.prob                  33.2124
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob          20.6288
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob   0.7683
## Party.fctr.All.X..rcv.rpart.prob                  0.3121
## .rnorm                                            0.0000
## Party.fctr.RFE.X..rcv.glmnet.prob                 0.0000
## Party.fctr.All.X.ica.rcv.glmnet.prob              0.0000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob        0.0000
##                                                 Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                         0.18691638
## Party.fctr.All.X..rcv.rf.prob                                      1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                  0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                    0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                    0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                   0.26899754
##                                                 Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.29307602
## Party.fctr.All.X..rcv.rf.prob                                          0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                        0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                       0.38646593
##                                                 Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.22802575
## Party.fctr.All.X..rcv.rf.prob                                        0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                      0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                      1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                     0.34105280
##                                                 Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.3723600
## Party.fctr.All.X..rcv.rf.prob                                        0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                      0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                      0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                     0.5046595
##                                                 Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.3953001
## Party.fctr.All.X..rcv.rf.prob                                             0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                           0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                          0.5048896
##                                                 Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                               0.31711659
## Party.fctr.All.X..rcv.rf.prob                                            0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                        0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                          0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                          0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                         0.42097008
##                                                 Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                          0.31052585
## Party.fctr.All.X..rcv.rf.prob                                       0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                   0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                     0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                     0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                    0.41412901
##                                                 Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                              0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                             0.46496974
##                                                 Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                          0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                        0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                       0.478386763
##                                                 Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6823105
##                                                 Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                           0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                              0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                        0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                     0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                 0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                   0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                   0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                  0.6823338
##                                                 Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
##                                                 Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                 0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                               0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                              0.6824249
##                                                 Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6824249
##                                                 Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.5228551
## Party.fctr.All.X..rcv.rf.prob                                             0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                           0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                          0.6824249
##                                                 Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                 0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                               0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                              0.6824249
##                                                 Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
##                                                 Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6824249
##                                                 Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.5228551
## Party.fctr.All.X..rcv.rf.prob                                           0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                         0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                        0.6824249
##                                                 Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5292805
## Party.fctr.All.X..rcv.rf.prob                                              0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                            0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                           0.6869501
##                                                 Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.5252550
## Party.fctr.All.X..rcv.rf.prob                                               0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                             0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                            0.6830104
##                                                 Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.4774014
## Party.fctr.All.X..rcv.rf.prob                                          0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                        0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                       0.6121520
##                                                 Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                            0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                         0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                      0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                  0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                    0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                    0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                   0.6635718
##                                                 Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.32079312
## Party.fctr.All.X..rcv.rf.prob                                          0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                      1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                        0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                       0.52072087
##                                                 Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.6071103
## Party.fctr.All.X..rcv.rf.prob                                          0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                        0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                       1.0000000
##                                                 Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                         0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                       0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                      0.4863653
##                                                 Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                    0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                  0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6071103
##                                                 Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.9648766
## Party.fctr.All.X..rcv.rf.prob                                              0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                            0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                           0.6126261
##                                                 Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.06921113
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      1.00000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.10805925
## Party.fctr.All.X..rcv.rf.prob                                             0.05594012
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.03712174
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.14756379
## Party.fctr.All.X..rcv.nnet.prob                                           0.04892984
## Party.fctr.All.X..rcv.rpart.prob                                          0.19560129
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.5387708 
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.5387700 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.5387700 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.5387700 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.5387700 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.5387700 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.5387700 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.5387700 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.5387700 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.5387568 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.5371265 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.5306966 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.5131595 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.5127080 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.5038432 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.4960004 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4856022 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.4741942 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.4732832 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.4685609 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.4674072 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.4527387 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4478403 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4472245 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4426068 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4398771 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4335478 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3832490 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.2078034 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.9##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob"
## [1] "myfit_mdl: setup complete: 0.680000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.1, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.901000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: alpha

## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1000   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        10   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                                     (Intercept) 
##                                     -2.43257913 
##                 Party.fctr.All.X..rcv.nnet.prob 
##                                      1.04408613 
##                   Party.fctr.All.X..rcv.rf.prob 
##                                      3.07552883 
##                Party.fctr.All.X..rcv.rpart.prob 
##                                      0.01388748 
##         Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                      0.66171681 
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                      0.02010406 
## [1] "max lambda < lambdaOpt:"
##                                     (Intercept) 
##                                    -2.530051398 
##                 Party.fctr.All.X..rcv.nnet.prob 
##                                     1.072728008 
##                   Party.fctr.All.X..rcv.rf.prob 
##                                     3.246212451 
##                Party.fctr.All.X..rcv.rpart.prob 
##                                     0.009106864 
##         Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                     0.663126140 
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                     0.025783892 
## [1] "myfit_mdl: train diagnostics complete: 3.515000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 170  67
##         R 109  97
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##    0.602708804    0.190716406    0.555450897    0.648585672    0.534988713 
## AccuracyPValue  McnemarPValue 
##    0.002389716    0.001998257 
## [1] "myfit_mdl: predict complete: 11.148000 secs"
##                            id
## 1 Ensemble.auto.9##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                  feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.214                 0.053
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5955819    0.6329114    0.5582524       0.6229773
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.55       0.5243243        0.6027088
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5554509             0.6485857     0.1907164
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.229000 secs"
## glmnet variable importance
## 
##                                                  Overall
## Party.fctr.All.X..rcv.rf.prob                   100.0000
## Party.fctr.All.X..rcv.nnet.prob                  33.2124
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob          20.6288
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob   0.7683
## Party.fctr.All.X..rcv.rpart.prob                  0.3121
## .rnorm                                            0.0000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob        0.0000
## Party.fctr.All.X.ica.rcv.glmnet.prob              0.0000
## Party.fctr.RFE.X..rcv.glmnet.prob                 0.0000
## Party.fctr.Max.cor.Y..rcv.rpart.prob              0.0000
##                                                 Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                         0.18691638
## Party.fctr.All.X..rcv.rf.prob                                      1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                  0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                    0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                    0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                   0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                               0.18355099
##                                                 Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.29307602
## Party.fctr.All.X..rcv.rf.prob                                          0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                        0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                       0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.28161821
##                                                 Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.22802575
## Party.fctr.All.X..rcv.rf.prob                                        0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                      0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                      1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                     0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                 0.22119074
##                                                 Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                           0.3723600
## Party.fctr.All.X..rcv.rf.prob                                        0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                    0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                      0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                      0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                     0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                 0.3603659
##                                                 Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.3953001
## Party.fctr.All.X..rcv.rf.prob                                             0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                           0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                          0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.3857298
##                                                 Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                               0.31711659
## Party.fctr.All.X..rcv.rf.prob                                            0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                        0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                          0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                          0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                         0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                     0.30844338
##                                                 Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                          0.31052585
## Party.fctr.All.X..rcv.rf.prob                                       0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                   0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                     0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                     0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                    0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                0.30232318
##                                                 Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                              0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                             0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.35388921
##                                                 Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                          0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                        0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                       0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.352759329
##                                                 Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226685
##                                                 Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                           0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                              0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                        0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                     0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                 0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                   0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                   0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                  0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                              0.5226850
##                                                 Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
##                                                 Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                 0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                               0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                              0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5226792
##                                                 Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226792
##                                                 Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.5228551
## Party.fctr.All.X..rcv.rf.prob                                             0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                           0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                          0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.5226792
##                                                 Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                 0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                               0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                              0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5226792
##                                                 Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
##                                                 Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226792
##                                                 Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.5228551
## Party.fctr.All.X..rcv.rf.prob                                           0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                         0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                        0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.5226792
##                                                 Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5292805
## Party.fctr.All.X..rcv.rf.prob                                              0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                            0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                           0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5292464
##                                                 Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.5252550
## Party.fctr.All.X..rcv.rf.prob                                               0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                             0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                            0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.5249946
##                                                 Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.4774014
## Party.fctr.All.X..rcv.rf.prob                                          0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                        0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                       0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.4683211
##                                                 Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                            0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                         0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                      0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                  0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                    0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                    0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                   0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                               0.5798453
##                                                 Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.32079312
## Party.fctr.All.X..rcv.rf.prob                                          0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                      1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                        0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                       0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30826132
##                                                 Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.6071103
## Party.fctr.All.X..rcv.rf.prob                                          0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                        0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                       1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.6126261
##                                                 Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                         0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                       0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                      0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.7287406
##                                                 Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                    0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                  0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.9648766
##                                                 Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.9648766
## Party.fctr.All.X..rcv.rf.prob                                              0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                            0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                           0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       1.0000000
##                                                 Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.06921113
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      1.00000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.10805925
## Party.fctr.All.X..rcv.rf.prob                                             0.05594012
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.03712174
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.14756379
## Party.fctr.All.X..rcv.nnet.prob                                           0.04892984
## Party.fctr.All.X..rcv.rpart.prob                                          0.19560129
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.20958662
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.5369822 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.5369822 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.5369822 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.5369822 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.5369822 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.5369822 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.5369822 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.5369822 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.5369816 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.5369711 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.5362509 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.5300630 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.5201677 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.5091914 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.5047414 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4997160 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.4990007 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.4879013 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.4802103 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4743994 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.4727318 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.4557774 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.4500900 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.4467640 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.4416299 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4196270 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4155786 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3610604 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.2080015 
## [1] "myfit_mdl: enter: 0.001000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.10##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.694000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.325, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.953000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1100   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        11   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                     (Intercept) Party.fctr.All.X..rcv.nnet.prob 
##                      -2.1049755                       0.7756052 
##   Party.fctr.All.X..rcv.rf.prob 
##                       3.3386591 
## [1] "max lambda < lambdaOpt:"
##                     (Intercept) Party.fctr.All.X..rcv.nnet.prob 
##                       -2.218281                        0.813180 
##   Party.fctr.All.X..rcv.rf.prob 
##                        3.535691 
## [1] "myfit_mdl: train diagnostics complete: 3.551000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold   f.score  accuracy
## 9       0.40 0.9993808 0.9994256
## 10      0.45 0.9993800 0.9994256
## 11      0.50 0.9993800 0.9994256
## 12      0.55 0.9993800 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold   f.score  accuracy
## 10      0.45 0.6004515 0.6004515
## 11      0.50 0.5518987 0.6004515

##          Prediction
## Reference   D   R
##         D 157  80
##         R  97 109
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##    0.600451467    0.192613034    0.553165390    0.646386898    0.534988713 
## AccuracyPValue  McnemarPValue 
##    0.003212337    0.229118122 
## [1] "myfit_mdl: predict complete: 11.097000 secs"
##                             id
## 1 Ensemble.auto.10##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                     feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.251                 0.043
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5957867    0.6624473    0.5291262       0.6129306
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.5       0.5518987        0.6004515
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5531654             0.6463869      0.192613
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.183000 secs"
## glmnet variable importance
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                        100.0
## Party.fctr.All.X..rcv.nnet.prob                       23.2
## .rnorm                                                 0.0
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob     0.0
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob             0.0
## Party.fctr.Max.cor.Y..rcv.rpart.prob                   0.0
## Party.fctr.All.X..rcv.rpart.prob                       0.0
## Party.fctr.RFE.X..rcv.glmnet.prob                      0.0
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                0.0
## Party.fctr.All.X.ica.rcv.glmnet.prob                   0.0
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob        0.0
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.5516021 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.5516021 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.5516021 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.5516021 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.5516021 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.5516021 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.5516021 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.5516021 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.5515931 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.5515828 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.5497798 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.5445016 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.5262862 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.5249013 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.5174248 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.5093946 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4975831 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.4974669 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4935482 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4923180 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.4863104 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.4838442 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.4777582 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4651399 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.4603534 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4389826 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4289042 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3625949 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1862447 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.11##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob"
## [1] "myfit_mdl: setup complete: 0.692000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.987000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1200   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        12   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.600000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.216000 secs"
##                             id
## 1 Ensemble.auto.11##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                       feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.286                  0.05
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.299000 secs"
## glmnet variable importance
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.5522890 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.5522890 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.5522890 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.5522890 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.5522890 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.5522890 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.5522890 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.5522890 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.5522576 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.5522462 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.5500289 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.5454348 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.5422725 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.5314453 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.5287503 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.5250097 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5094122 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5052116 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.5050030 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.4990750 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.4883868 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4874815 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4742818 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4742051 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4543528 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4512314 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4433356 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4042709 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1746936 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.12##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob"
## [1] "myfit_mdl: setup complete: 0.676000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.035000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1300   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        13   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.645000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.342000 secs"
##                             id
## 1 Ensemble.auto.12##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                        feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                       2.35                 0.051
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.425000 secs"
## glmnet variable importance
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.5798771 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.5798771 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.5798771 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.5798771 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.5798771 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.5798771 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.5798771 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.5798771 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.5798527 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.5798460 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.5772662 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.5723975 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.5590987 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.5491603 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.5429970 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.5414602 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.5310212 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.5160950 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5138204 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.5099449 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5093904 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4978707 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4744715 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4737851 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4610310 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4540303 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4508919 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3981844 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1719770 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.13##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob"
## [1] "myfit_mdl: setup complete: 0.680000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.977000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1400   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        14   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.594000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.282000 secs"
##                             id
## 1 Ensemble.auto.13##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.287                 0.051
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.374000 secs"
## glmnet variable importance
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.All.X..rcv.glm.prob                        0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.5862862 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.5862862 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.5862862 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.5862862 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.5862862 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.5862862 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.5862862 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.5862862 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.5862687 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.5862615 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.5857931 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.5826602 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.5785046 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.5683346 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.5600635 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.5532338 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.5511537 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.5476414 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.5385975 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5302013 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5249945 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4914291 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4725696 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4665150 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4618603 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4605957 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4428279 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4047404 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1660256 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.14##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.682000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.061000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1500   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        15   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.676000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.442000 secs"
##                             id
## 1 Ensemble.auto.14##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.369                 0.053
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.528000 secs"
## glmnet variable importance
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.All.X..rcv.glm.prob                        0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.6106307 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.6106307 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.6106307 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.6106307 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.6106307 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.6106307 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.6106307 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.6106307 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.6106181 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.6106134 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.6076094 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.6037676 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.5932031 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.5832141 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.5728028 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.5667446 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.5583275 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.5554430 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.5496009 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5338550 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5240838 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5037250 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4874989 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4707731 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4696451 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4691135 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4446796 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3998624 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1701271 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.15##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob"
## [1] "myfit_mdl: setup complete: 0.679000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.078000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1600   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        16   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.704000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.451000 secs"
##                             id
## 1 Ensemble.auto.15##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.389                 0.053
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.539000 secs"
## glmnet variable importance
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.glm.prob                        0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.All.X..rcv.bayesglm.prob                   0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.6148139 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.6148139 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.6148139 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.6148139 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.6148139 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.6148139 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.6148139 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.6148139 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.6148061 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.6148008 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6145918 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.6109582 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.6076482 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.5934711 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.5850801 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.5832774 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.5817846 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.5795541 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.5636462 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5473609 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5369176 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4982080 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4911329 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4858846 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4594765 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4584022 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4385632 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4054885 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1651851 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.16##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob"
## [1] "myfit_mdl: setup complete: 0.683000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.135000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1700   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        17   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.734000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.526000 secs"
##                             id
## 1 Ensemble.auto.16##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.441                 0.054
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.615000 secs"
## glmnet variable importance
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.gbm.prob                        0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.All.X..rcv.bayesglm.prob                   0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X..rcv.glm.prob                        0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6286144 
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.6229391 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.6229391 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.6229391 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.6229391 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.6229391 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.6229391 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.6229391 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.6229391 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.6229370 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.6229264 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.6184415 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.6156542 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6079230 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6068971 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.5980341 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.5922884 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.5876725 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.5709976 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5570780 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5485045 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.4995445 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.4986112 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4962782 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4540317 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4522749 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4344127 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4171261 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1613418 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.17##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.683000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.175000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1800   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        18   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.789000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.599000 secs"
##                             id
## 1 Ensemble.auto.17##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.481                 0.056
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.689000 secs"
## glmnet variable importance
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.gbm.prob                        0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob                 0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.All.X..rcv.bayesglm.prob                   0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X..rcv.glm.prob                        0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.6448044 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.6448044 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.6448044 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.6448044 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.6448044 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.6448044 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.6448044 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.6448044 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.6447998 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.6447897 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.6400920 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.6382627 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6367576 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6154419 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6132751 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.6079380 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6017954 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.5957885 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.5885264 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5639821 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5488729 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.5184520 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5094582 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.4960204 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4582214 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4565525 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4345427 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4135887 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1645278 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.18##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob"
## [1] "myfit_mdl: setup complete: 0.682000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.516000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1900   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        19   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 4.124000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.939000 secs"
##                             id
## 1 Ensemble.auto.18##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.823                 0.055
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 12.030000 secs"
## glmnet variable importance
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob                 0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X..rcv.bagEarth.prob                   0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.All.X..rcv.gbm.prob                        0.00
## Party.fctr.All.X..rcv.bayesglm.prob                   0.00
## Party.fctr.All.X..rcv.glm.prob                        0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6569377 
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.6523981 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.6523981 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.6523981 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.6523981 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.6523981 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.6523981 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.6523981 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.6523981 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.6523908 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.6523792 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.6471709 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.6454175 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6287143 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6278592 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6191420 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6130294 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.6124711 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.5971743 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5747613 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5581569 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.5243632 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5092044 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5047636 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4547257 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4526179 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4340679 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4184269 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1614420 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.19##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.676000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.184000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        2000   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        20   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.793000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.567000 secs"
##                             id
## 1 Ensemble.auto.19##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.497                 0.055
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.659000 secs"
## glmnet variable importance
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.All.X..rcv.bagEarth.prob                   0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob                 0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.gbm.prob                        0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X..rcv.bayesglm.prob                   0.00
## Party.fctr.All.X..rcv.glm.prob                        0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.6702902 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.6702902 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.6702902 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.6702902 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.6702902 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.6702902 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.6702902 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.6702902 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.6702836 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.6702722 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.6657408 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.6633692 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6627574 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6332714 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6331170 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.6292857 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6211789 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6148378 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.6118954 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5798549 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5578602 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.5401399 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5185594 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5039813 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4586497 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4566510 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4364628 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4151191 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1644842 
## [1] "myfit_mdl: enter: 0.001000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.20##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.705000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.303000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        2100   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        21   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.922000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 12.264000 secs"
##                             id
## 1 Ensemble.auto.20##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.586                 0.057
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 12.356000 secs"
## glmnet variable importance
## 
##   only 20 most important variables shown (out of 21)
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.bagEarth.prob                   0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob                 0.00
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob           0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.gbm.prob                        0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.All.X..rcv.bayesglm.prob                   0.00
## Party.fctr.All.X..rcv.glm.prob                        0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                           0.36218938
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.55888047
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.50042634
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.7448104
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.7814010
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.67342431
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                            0.66324781
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.72536860
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                               0.683087856
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.9999995
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.9999625
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                0.9999625
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.9923451
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                    0.9946031
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.8834434
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                           0.9271877
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.81793414
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.6823338
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                              0.4752093
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.5228501
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.5226850
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.223743171
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.6867738 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.6867738 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.6867738 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.6867738 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.6867738 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.6867738 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.6867738 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.6867738 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.6867694 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.6867585 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.6820710 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.6799309 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6686895 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.6441808 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6388483 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6377295 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.6254728 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6237911 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6172583 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5850166 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5579112 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.5540296 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5267481 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5038036 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4618597 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4599527 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4384002 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4124726 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1674472 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.21##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.681000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.329000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        2200   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        22   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.943000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.809000 secs"
##                             id
## 1 Ensemble.auto.21##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.636                  0.06
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.901000 secs"
## glmnet variable importance
## 
##   only 20 most important variables shown (out of 22)
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob                 0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.bagEarth.prob                   0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob           0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob            0.00
## Party.fctr.All.X..rcv.gbm.prob                        0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.All.X..rcv.bayesglm.prob                   0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                           0.36218938
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                            0.36221072
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.55888047
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.55890298
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.50042634
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.50046713
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.7448104
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.7449006
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.7814010
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.7814371
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.67342431
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.67343809
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                            0.66324781
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.66326077
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.72536860
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.72541681
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                               0.683087856
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                                0.683096130
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.9999995
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                           0.9999995
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.9999615
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9999615
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.9923451
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9923540
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                    0.9946031
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9946048
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.8834434
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.8833991
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                           0.9271877
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                            0.9271592
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.81793414
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.81804259
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.6823338
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.6823105
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                              0.4752093
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                               0.4751697
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.5228501
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.5228300
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.5226850
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.5226685
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.223743171
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.223718696
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.7016875 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.7016875 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.7016875 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.7016875 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.7016875 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.7016875 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.7016875 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.7016875 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.7016851 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.7016748 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.6968464 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.6949154 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6740585 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.6576560 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6438984 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6419051 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.6377550 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6261553 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6194488 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5896870 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.5666017 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5579584 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5341559 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5036447 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4647630 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4629392 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4401511 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4100792 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1701268 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.22##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.705000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.332000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        2300   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        23   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.958000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.881000 secs"
##                             id
## 1 Ensemble.auto.22##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.615                 0.062
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 11.974000 secs"
## glmnet variable importance
## 
##   only 20 most important variables shown (out of 23)
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.All.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob                  0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob            0.00
## Party.fctr.All.X..rcv.bagEarth.prob                   0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob           0.00
## Party.fctr.All.X..rcv.gbm.prob                        0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob                 0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                           0.36218938
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                            0.36221072
## Party.fctr.All.X..rcv.glmnet.prob                                     0.36224450
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.55888047
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.55890298
## Party.fctr.All.X..rcv.glmnet.prob                                         0.55915752
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.50042634
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.50046713
## Party.fctr.All.X..rcv.glmnet.prob                                       0.50008535
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.7448104
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.7449006
## Party.fctr.All.X..rcv.glmnet.prob                                       0.7448175
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.7814010
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.7814371
## Party.fctr.All.X..rcv.glmnet.prob                                            0.7814906
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.67342431
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.67343809
## Party.fctr.All.X..rcv.glmnet.prob                                           0.67337849
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                            0.66324781
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.66326077
## Party.fctr.All.X..rcv.glmnet.prob                                      0.66319583
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.72536860
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.72541681
## Party.fctr.All.X..rcv.glmnet.prob                                               0.72541583
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                               0.683087856
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                                0.683096130
## Party.fctr.All.X..rcv.glmnet.prob                                                         0.683181734
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.9999995
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9999615
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                           0.9999995
## Party.fctr.All.X..rcv.glmnet.prob                                                    0.9999625
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                            1.0000000
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.9923451
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9923540
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9923493
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                    0.9946031
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9946048
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9946489
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.8834434
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.8833991
## Party.fctr.All.X..rcv.glmnet.prob                                         0.8833465
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                           0.9271877
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                            0.9271592
## Party.fctr.All.X..rcv.glmnet.prob                                                     0.9271085
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.81793414
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.81804259
## Party.fctr.All.X..rcv.glmnet.prob                                         0.81803046
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.6823338
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.6823105
## Party.fctr.All.X..rcv.glmnet.prob                                         0.6824249
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                              0.4752093
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                               0.4751697
## Party.fctr.All.X..rcv.glmnet.prob                                                        0.4752537
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.5228501
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.5228551
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.5226850
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.5226685
## Party.fctr.All.X..rcv.glmnet.prob                                             0.5226792
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.223743171
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.223718696
## Party.fctr.All.X..rcv.glmnet.prob                                           0.223850420
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.7152472 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.7152472 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.7152472 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.7152472 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.7152472 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.7152472 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.7152472 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.7152472 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.7152431 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.7152333 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.7102784 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.7085396 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6789418 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.6699038 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.6489183 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6484857 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6457011 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6283018 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6214373 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5939368 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.5780302 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5580129 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5408954 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5034829 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4674036 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4656546 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4417467 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4079049 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1725687 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.23##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.684000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.438000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        2400   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        24   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 4.054000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.953000 secs"
##                             id
## 1 Ensemble.auto.23##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.741                 0.062
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 12.050000 secs"
## glmnet variable importance
## 
##   only 20 most important variables shown (out of 24)
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.All.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob                  0.00
## Party.fctr.All.X.center.scale.rcv.glmnet.prob         0.00
## Party.fctr.All.X..rcv.bagEarth.prob                   0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob                 0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob           0.00
## Party.fctr.All.X..rcv.gbm.prob                        0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                           0.36218938
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                            0.36221072
## Party.fctr.All.X..rcv.glmnet.prob                                     0.36224450
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                         0.36224450
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.55888047
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.55890298
## Party.fctr.All.X..rcv.glmnet.prob                                         0.55915752
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.55915753
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.50042634
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.50046713
## Party.fctr.All.X..rcv.glmnet.prob                                       0.50008535
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.50008535
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.7448104
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.7449006
## Party.fctr.All.X..rcv.glmnet.prob                                       0.7448175
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.7448175
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.7814010
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.7814371
## Party.fctr.All.X..rcv.glmnet.prob                                            0.7814906
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                0.7814906
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.67342431
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.67343809
## Party.fctr.All.X..rcv.glmnet.prob                                           0.67337849
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.67337849
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                            0.66324781
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.66326077
## Party.fctr.All.X..rcv.glmnet.prob                                      0.66319583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                          0.66319583
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.72536860
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.72541681
## Party.fctr.All.X..rcv.glmnet.prob                                               0.72541583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   0.72541583
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                               0.683087856
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                                0.683096130
## Party.fctr.All.X..rcv.glmnet.prob                                                         0.683181734
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                             0.683181734
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.9999995
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9999615
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.9999615
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                           0.9999995
## Party.fctr.All.X..rcv.glmnet.prob                                                    0.9999625
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                        0.9999625
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                            1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                1.0000000
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                              1.0000000
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.9923451
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9923540
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.9923493
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                    0.9946031
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9946048
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9946489
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                  0.9946489
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.8834434
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.8833991
## Party.fctr.All.X..rcv.glmnet.prob                                         0.8833465
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.8833465
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                           0.9271877
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                            0.9271592
## Party.fctr.All.X..rcv.glmnet.prob                                                     0.9271085
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                         0.9271085
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.81793414
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.81804259
## Party.fctr.All.X..rcv.glmnet.prob                                         0.81803046
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.81803046
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.6823338
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.6823105
## Party.fctr.All.X..rcv.glmnet.prob                                         0.6824249
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.6824249
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                              0.4752093
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                               0.4751697
## Party.fctr.All.X..rcv.glmnet.prob                                                        0.4752537
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                            0.4752537
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.5228501
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.5228551
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.5228551
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.5226850
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.5226685
## Party.fctr.All.X..rcv.glmnet.prob                                             0.5226792
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.5226792
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.223743171
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.223718696
## Party.fctr.All.X..rcv.glmnet.prob                                           0.223850420
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.223850420
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.7276278 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.7276278 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.7276278 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.7276278 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.7276278 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.7276278 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.7276278 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.7276278 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.7276222 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.7276128 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.7225423 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.7209792 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6834004 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.6810866 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.6591108 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6526740 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6491669 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6302616 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6232529 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.5978170 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.5884650 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5580627 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5470488 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5033352 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4698145 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4681340 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4432035 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4059197 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1747984 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.24##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.708000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.421000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        2500   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        25   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 4.039000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 12.017000 secs"
##                             id
## 1 Ensemble.auto.24##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                        2.7                 0.065
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 12.114000 secs"
## glmnet variable importance
## 
##   only 20 most important variables shown (out of 25)
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob                  0.00
## Party.fctr.All.X.center.scale.rcv.glmnet.prob         0.00
## Party.fctr.All.X..rcv.bagEarth.prob                   0.00
## Party.fctr.All.X.scale.rcv.glmnet.prob                0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob                 0.00
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob           0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                           0.36218938
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                            0.36221072
## Party.fctr.All.X..rcv.glmnet.prob                                     0.36224450
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                         0.36224450
## Party.fctr.All.X.scale.rcv.glmnet.prob                                0.36224450
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.55888047
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.55890298
## Party.fctr.All.X..rcv.glmnet.prob                                         0.55915752
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.55915753
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.55915753
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.50042634
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.50046713
## Party.fctr.All.X..rcv.glmnet.prob                                       0.50008535
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.50008535
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.50008535
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.7448104
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.7449006
## Party.fctr.All.X..rcv.glmnet.prob                                       0.7448175
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.7448175
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.7448175
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.7814010
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.7814371
## Party.fctr.All.X..rcv.glmnet.prob                                            0.7814906
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                0.7814906
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       0.7814906
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.67342431
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.67343809
## Party.fctr.All.X..rcv.glmnet.prob                                           0.67337849
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.67337849
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.67337849
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                            0.66324781
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.66326077
## Party.fctr.All.X..rcv.glmnet.prob                                      0.66319583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                          0.66319583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                 0.66319583
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.72536860
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.72541681
## Party.fctr.All.X..rcv.glmnet.prob                                               0.72541583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   0.72541583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          0.72541583
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                               0.683087856
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                                0.683096130
## Party.fctr.All.X..rcv.glmnet.prob                                                         0.683181734
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                             0.683181734
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                    0.683181734
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.9999995
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9999615
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.9999615
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                           0.9999995
## Party.fctr.All.X..rcv.glmnet.prob                                                    0.9999625
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                        0.9999625
## Party.fctr.All.X.scale.rcv.glmnet.prob                                               0.9999625
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                            1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       1.0000000
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                              1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                     1.0000000
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.9923451
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9923540
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.9923493
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.9923493
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                    0.9946031
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9946048
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9946489
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                  0.9946489
## Party.fctr.All.X.scale.rcv.glmnet.prob                                         0.9946489
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.8834434
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.8833991
## Party.fctr.All.X..rcv.glmnet.prob                                         0.8833465
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.8833465
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.8833465
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                           0.9271877
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                            0.9271592
## Party.fctr.All.X..rcv.glmnet.prob                                                     0.9271085
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                         0.9271085
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                0.9271085
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.81793414
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.81804259
## Party.fctr.All.X..rcv.glmnet.prob                                         0.81803046
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.81803046
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.81803046
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.6823338
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.6823105
## Party.fctr.All.X..rcv.glmnet.prob                                         0.6824249
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.6824249
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.6824249
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                              0.4752093
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                               0.4751697
## Party.fctr.All.X..rcv.glmnet.prob                                                        0.4752537
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                            0.4752537
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                   0.4752537
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.5228501
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.5228551
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.5228551
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.5228551
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.5226850
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.5226685
## Party.fctr.All.X..rcv.glmnet.prob                                             0.5226792
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.5226792
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.5226792
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.223743171
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.223718696
## Party.fctr.All.X..rcv.glmnet.prob                                           0.223850420
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.223850420
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.223850420
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.7389766 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.7389766 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.7389766 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.7389766 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.7389766 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.7389766 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.7389766 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.7389766 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.7389696 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.7389607 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.7337843 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.7323821 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.6913375 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6874875 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.6684539 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6565133 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6523440 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6320582 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6249172 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.6013739 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.5980303 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5581083 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5526895 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5031998 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4720245 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4704067 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4445389 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4040999 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1768422 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.25##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.708000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.401000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        2600   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        26   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 4.016000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 12.075000 secs"
##                             id
## 1 Ensemble.auto.25##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                       2.68                 0.066
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 12.172000 secs"
## glmnet variable importance
## 
##   only 20 most important variables shown (out of 26)
## 
##                                                 Overall
## Party.fctr.All.X..rcv.rf.prob                    100.00
## Party.fctr.All.X..rcv.avNNet.prob                 37.32
## .rnorm                                             0.00
## Party.fctr.All.X..rcv.earth.prob                   0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob               0.00
## Party.fctr.All.X..rcv.nnet.prob                    0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob       0.00
## Party.fctr.All.X..rcv.glmnet.prob                  0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob         0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob         0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob               0.00
## Party.fctr.All.X.center.rcv.glmnet.prob            0.00
## Party.fctr.All.X..rcv.bagEarth.prob                0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob               0.00
## Party.fctr.All.X.scale.rcv.glmnet.prob             0.00
## Party.fctr.All.X..rcv.rpart.prob                   0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob            0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob              0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob    0.00
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob        0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                           0.36218938
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                            0.36221072
## Party.fctr.All.X..rcv.glmnet.prob                                     0.36224450
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                         0.36224450
## Party.fctr.All.X.scale.rcv.glmnet.prob                                0.36224450
## Party.fctr.All.X.center.rcv.glmnet.prob                               0.36224450
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.55888047
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.55890298
## Party.fctr.All.X..rcv.glmnet.prob                                         0.55915752
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.55915753
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.55915753
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.55915753
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.50042634
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.50046713
## Party.fctr.All.X..rcv.glmnet.prob                                       0.50008535
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.50008535
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.50008535
## Party.fctr.All.X.center.rcv.glmnet.prob                                 0.50008535
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.7448104
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.7449006
## Party.fctr.All.X..rcv.glmnet.prob                                       0.7448175
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.7448175
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.7448175
## Party.fctr.All.X.center.rcv.glmnet.prob                                 0.7448175
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.7814010
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.7814371
## Party.fctr.All.X..rcv.glmnet.prob                                            0.7814906
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                0.7814906
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       0.7814906
## Party.fctr.All.X.center.rcv.glmnet.prob                                      0.7814906
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.67342431
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.67343809
## Party.fctr.All.X..rcv.glmnet.prob                                           0.67337849
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.67337849
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.67337849
## Party.fctr.All.X.center.rcv.glmnet.prob                                     0.67337849
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                            0.66324781
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.66326077
## Party.fctr.All.X..rcv.glmnet.prob                                      0.66319583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                          0.66319583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                 0.66319583
## Party.fctr.All.X.center.rcv.glmnet.prob                                0.66319583
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.72536860
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.72541681
## Party.fctr.All.X..rcv.glmnet.prob                                               0.72541583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   0.72541583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          0.72541583
## Party.fctr.All.X.center.rcv.glmnet.prob                                         0.72541583
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                               0.683087856
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                                0.683096130
## Party.fctr.All.X..rcv.glmnet.prob                                                         0.683181734
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                             0.683181734
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                    0.683181734
## Party.fctr.All.X.center.rcv.glmnet.prob                                                   0.683181734
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.9999995
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9999615
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.9999615
## Party.fctr.All.X.center.rcv.glmnet.prob                                             0.9999615
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                           0.9999995
## Party.fctr.All.X..rcv.glmnet.prob                                                    0.9999625
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                        0.9999625
## Party.fctr.All.X.scale.rcv.glmnet.prob                                               0.9999625
## Party.fctr.All.X.center.rcv.glmnet.prob                                              0.9999625
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                         1.0000000
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                                1.0000000
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                            1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                      1.0000000
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                         1.0000000
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                                1.0000000
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                              1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                     1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                    1.0000000
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.9923451
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9923540
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.9923493
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.9923493
## Party.fctr.All.X.center.rcv.glmnet.prob                                       0.9923493
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                    0.9946031
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9946048
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9946489
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                  0.9946489
## Party.fctr.All.X.scale.rcv.glmnet.prob                                         0.9946489
## Party.fctr.All.X.center.rcv.glmnet.prob                                        0.9946489
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.8834434
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.8833991
## Party.fctr.All.X..rcv.glmnet.prob                                         0.8833465
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.8833465
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.8833465
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.8833465
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                           0.9271877
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                            0.9271592
## Party.fctr.All.X..rcv.glmnet.prob                                                     0.9271085
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                         0.9271085
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                0.9271085
## Party.fctr.All.X.center.rcv.glmnet.prob                                               0.9271085
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.81793414
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.81804259
## Party.fctr.All.X..rcv.glmnet.prob                                         0.81803046
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.81803046
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.81803046
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.81803046
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.6823338
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.6823105
## Party.fctr.All.X..rcv.glmnet.prob                                         0.6824249
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.6824249
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.6824249
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.6824249
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                              0.4752093
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                               0.4751697
## Party.fctr.All.X..rcv.glmnet.prob                                                        0.4752537
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                            0.4752537
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                   0.4752537
## Party.fctr.All.X.center.rcv.glmnet.prob                                                  0.4752537
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.5228501
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.5228551
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.5228551
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.5228551
## Party.fctr.All.X.center.rcv.glmnet.prob                                             0.5228551
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.5226850
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.5226685
## Party.fctr.All.X..rcv.glmnet.prob                                             0.5226792
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.5226792
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.5226792
## Party.fctr.All.X.center.rcv.glmnet.prob                                       0.5226792
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.223743171
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.223718696
## Party.fctr.All.X..rcv.glmnet.prob                                           0.223850420
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.223850420
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.223850420
## Party.fctr.All.X.center.rcv.glmnet.prob                                     0.223850420
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.7494175 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.7494175 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.7494175 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.7494175 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.7494175 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.7494175 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.7494175 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.7494175 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.7494093 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.7494008 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.7441269 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.7428728 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.7007684 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6912476 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.6770496 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6600455 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6552668 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6337110 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6264484 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.6068303 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.6046462 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5581503 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5578789 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5030752 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4740578 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4724976 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4457675 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4024256 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1787225 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.26##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.686000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.354000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        2700   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        27   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.969000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.905000 secs"
##                             id
## 1 Ensemble.auto.26##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.654                 0.069
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 12.003000 secs"
## glmnet variable importance
## 
##   only 20 most important variables shown (out of 27)
## 
##                                                 Overall
## Party.fctr.All.X..rcv.rf.prob                    100.00
## Party.fctr.All.X..rcv.avNNet.prob                 37.32
## .rnorm                                             0.00
## Party.fctr.All.X..rcv.earth.prob                   0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob              0.00
## Party.fctr.All.X..rcv.nnet.prob                    0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob       0.00
## Party.fctr.All.X..rcv.glmnet.prob                  0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob         0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob               0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob               0.00
## Party.fctr.All.X.center.rcv.glmnet.prob            0.00
## Party.fctr.All.X..rcv.bagEarth.prob                0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob               0.00
## Party.fctr.All.X.scale.rcv.glmnet.prob             0.00
## Party.fctr.All.X..rcv.rpart.prob                   0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob            0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob    0.00
## Party.fctr.All.X.zv.rcv.glmnet.prob                0.00
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob        0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                           0.36218938
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                            0.36221072
## Party.fctr.All.X..rcv.glmnet.prob                                     0.36224450
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                         0.36224450
## Party.fctr.All.X.scale.rcv.glmnet.prob                                0.36224450
## Party.fctr.All.X.center.rcv.glmnet.prob                               0.36224450
## Party.fctr.All.X.zv.rcv.glmnet.prob                                   0.36224450
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.55888047
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.55890298
## Party.fctr.All.X..rcv.glmnet.prob                                         0.55915752
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.55915753
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.55915753
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.55915753
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.55915753
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.50042634
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.50046713
## Party.fctr.All.X..rcv.glmnet.prob                                       0.50008535
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.50008535
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.50008535
## Party.fctr.All.X.center.rcv.glmnet.prob                                 0.50008535
## Party.fctr.All.X.zv.rcv.glmnet.prob                                     0.50008535
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.7448104
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.7449006
## Party.fctr.All.X..rcv.glmnet.prob                                       0.7448175
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.7448175
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.7448175
## Party.fctr.All.X.center.rcv.glmnet.prob                                 0.7448175
## Party.fctr.All.X.zv.rcv.glmnet.prob                                     0.7448175
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.7814010
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.7814371
## Party.fctr.All.X..rcv.glmnet.prob                                            0.7814906
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                0.7814906
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       0.7814906
## Party.fctr.All.X.center.rcv.glmnet.prob                                      0.7814906
## Party.fctr.All.X.zv.rcv.glmnet.prob                                          0.7814906
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.67342431
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.67343809
## Party.fctr.All.X..rcv.glmnet.prob                                           0.67337849
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.67337849
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.67337849
## Party.fctr.All.X.center.rcv.glmnet.prob                                     0.67337849
## Party.fctr.All.X.zv.rcv.glmnet.prob                                         0.67337849
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                            0.66324781
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.66326077
## Party.fctr.All.X..rcv.glmnet.prob                                      0.66319583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                          0.66319583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                 0.66319583
## Party.fctr.All.X.center.rcv.glmnet.prob                                0.66319583
## Party.fctr.All.X.zv.rcv.glmnet.prob                                    0.66319583
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.72536860
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.72541681
## Party.fctr.All.X..rcv.glmnet.prob                                               0.72541583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   0.72541583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          0.72541583
## Party.fctr.All.X.center.rcv.glmnet.prob                                         0.72541583
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             0.72541583
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                               0.683087856
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                                0.683096130
## Party.fctr.All.X..rcv.glmnet.prob                                                         0.683181734
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                             0.683181734
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                    0.683181734
## Party.fctr.All.X.center.rcv.glmnet.prob                                                   0.683181734
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                       0.683181734
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.9999995
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9999615
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.9999615
## Party.fctr.All.X.center.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                 0.9999615
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                           0.9999995
## Party.fctr.All.X..rcv.glmnet.prob                                                    0.9999625
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                        0.9999625
## Party.fctr.All.X.scale.rcv.glmnet.prob                                               0.9999625
## Party.fctr.All.X.center.rcv.glmnet.prob                                              0.9999625
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                  0.9999625
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             1.0000000
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                              1.0000000
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                    1.0000000
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                            1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                      1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                              1.0000000
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             1.0000000
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                    1.0000000
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                              1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                     1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                        1.0000000
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.9923451
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9923540
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.9923493
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.9923493
## Party.fctr.All.X.center.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.zv.rcv.glmnet.prob                                           0.9923493
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                    0.9946031
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9946048
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9946489
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                  0.9946489
## Party.fctr.All.X.scale.rcv.glmnet.prob                                         0.9946489
## Party.fctr.All.X.center.rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X.zv.rcv.glmnet.prob                                            0.9946489
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.8834434
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.8833991
## Party.fctr.All.X..rcv.glmnet.prob                                         0.8833465
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.8833465
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.8833465
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.8833465
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.8833465
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                           0.9271877
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                            0.9271592
## Party.fctr.All.X..rcv.glmnet.prob                                                     0.9271085
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                         0.9271085
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                0.9271085
## Party.fctr.All.X.center.rcv.glmnet.prob                                               0.9271085
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                   0.9271085
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.81793414
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.81804259
## Party.fctr.All.X..rcv.glmnet.prob                                         0.81803046
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.81803046
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.81803046
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.81803046
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.81803046
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.6823338
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.6823105
## Party.fctr.All.X..rcv.glmnet.prob                                         0.6824249
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.6824249
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.6824249
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.6824249
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.6824249
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                              0.4752093
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                               0.4751697
## Party.fctr.All.X..rcv.glmnet.prob                                                        0.4752537
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                            0.4752537
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                   0.4752537
## Party.fctr.All.X.center.rcv.glmnet.prob                                                  0.4752537
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                      0.4752537
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.5228501
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.5228551
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.5228551
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.5228551
## Party.fctr.All.X.center.rcv.glmnet.prob                                             0.5228551
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                 0.5228551
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.5226850
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.5226685
## Party.fctr.All.X..rcv.glmnet.prob                                             0.5226792
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.5226792
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.5226792
## Party.fctr.All.X.center.rcv.glmnet.prob                                       0.5226792
## Party.fctr.All.X.zv.rcv.glmnet.prob                                           0.5226792
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.223743171
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.223718696
## Party.fctr.All.X..rcv.glmnet.prob                                           0.223850420
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.223850420
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.223850420
## Party.fctr.All.X.center.rcv.glmnet.prob                                     0.223850420
## Party.fctr.All.X.zv.rcv.glmnet.prob                                         0.223850420
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.7590553 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.7590553 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.7590553 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.7590553 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.7590553 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.7590553 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.7590553 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.7590553 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.7590459 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.7590378 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.7536739 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.7525564 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.7094738 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6947185 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.6849841 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6633059 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6579649 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6352367 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6278617 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.6149533 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.6076668 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5626691 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5581890 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5029602 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4759346 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4744277 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4469016 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.4008802 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1804582 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.27##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.678000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.580000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        2800   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        28   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 4.201000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 12.181000 secs"
##                             id
## 1 Ensemble.auto.27##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.887                  0.07
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 12.279000 secs"
## glmnet variable importance
## 
##   only 20 most important variables shown (out of 28)
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X.scale.rcv.glmnet.prob                0.00
## Party.fctr.All.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob         0.00
## Party.fctr.Low.cor.X..rcv.glmnet.prob                 0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob            0.00
## Party.fctr.All.X.center.rcv.glmnet.prob               0.00
## Party.fctr.All.X..rcv.bagEarth.prob                   0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
## Party.fctr.All.X.zv.rcv.glmnet.prob                   0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                           0.36218938
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                            0.36221072
## Party.fctr.All.X..rcv.glmnet.prob                                     0.36224450
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                         0.36224450
## Party.fctr.All.X.scale.rcv.glmnet.prob                                0.36224450
## Party.fctr.All.X.center.rcv.glmnet.prob                               0.36224450
## Party.fctr.All.X.zv.rcv.glmnet.prob                                   0.36224450
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                         0.36224450
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.55888047
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.55890298
## Party.fctr.All.X..rcv.glmnet.prob                                         0.55915752
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.55915753
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.55915753
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.55915753
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.55915753
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.55915753
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.50042634
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.50046713
## Party.fctr.All.X..rcv.glmnet.prob                                       0.50008535
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.50008535
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.50008535
## Party.fctr.All.X.center.rcv.glmnet.prob                                 0.50008535
## Party.fctr.All.X.zv.rcv.glmnet.prob                                     0.50008535
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                           0.50008535
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.7448104
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.7449006
## Party.fctr.All.X..rcv.glmnet.prob                                       0.7448175
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.7448175
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.7448175
## Party.fctr.All.X.center.rcv.glmnet.prob                                 0.7448175
## Party.fctr.All.X.zv.rcv.glmnet.prob                                     0.7448175
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                           0.7448175
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.7814010
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.7814371
## Party.fctr.All.X..rcv.glmnet.prob                                            0.7814906
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                0.7814906
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       0.7814906
## Party.fctr.All.X.center.rcv.glmnet.prob                                      0.7814906
## Party.fctr.All.X.zv.rcv.glmnet.prob                                          0.7814906
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                0.7814906
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.67342431
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.67343809
## Party.fctr.All.X..rcv.glmnet.prob                                           0.67337849
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.67337849
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.67337849
## Party.fctr.All.X.center.rcv.glmnet.prob                                     0.67337849
## Party.fctr.All.X.zv.rcv.glmnet.prob                                         0.67337849
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                               0.67337849
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                            0.66324781
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.66326077
## Party.fctr.All.X..rcv.glmnet.prob                                      0.66319583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                          0.66319583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                 0.66319583
## Party.fctr.All.X.center.rcv.glmnet.prob                                0.66319583
## Party.fctr.All.X.zv.rcv.glmnet.prob                                    0.66319583
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                          0.66319583
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.72536860
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.72541681
## Party.fctr.All.X..rcv.glmnet.prob                                               0.72541583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   0.72541583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          0.72541583
## Party.fctr.All.X.center.rcv.glmnet.prob                                         0.72541583
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             0.72541583
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                   0.72541583
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                               0.683087856
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                                0.683096130
## Party.fctr.All.X..rcv.glmnet.prob                                                         0.683181734
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                             0.683181734
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                    0.683181734
## Party.fctr.All.X.center.rcv.glmnet.prob                                                   0.683181734
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                       0.683181734
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                             0.683181734
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.9999995
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9999615
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.9999615
## Party.fctr.All.X.center.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                 0.9999615
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                       0.9999615
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                           0.9999995
## Party.fctr.All.X..rcv.glmnet.prob                                                    0.9999625
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                        0.9999625
## Party.fctr.All.X.scale.rcv.glmnet.prob                                               0.9999625
## Party.fctr.All.X.center.rcv.glmnet.prob                                              0.9999625
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                  0.9999625
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                        0.9999625
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                   1.0000000
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                              1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                    1.0000000
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                    1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                            1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                      1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                1.0000000
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                              1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                    1.0000000
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                   1.0000000
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                    1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                              1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                     1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                              1.0000000
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.9923451
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9923540
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.9923493
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.9923493
## Party.fctr.All.X.center.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.zv.rcv.glmnet.prob                                           0.9923493
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                 0.9923493
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                    0.9946031
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9946048
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9946489
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                  0.9946489
## Party.fctr.All.X.scale.rcv.glmnet.prob                                         0.9946489
## Party.fctr.All.X.center.rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X.zv.rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                  0.9946489
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.8834434
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.8833991
## Party.fctr.All.X..rcv.glmnet.prob                                         0.8833465
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.8833465
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.8833465
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.8833465
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.8833465
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.8833465
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                           0.9271877
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                            0.9271592
## Party.fctr.All.X..rcv.glmnet.prob                                                     0.9271085
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                         0.9271085
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                0.9271085
## Party.fctr.All.X.center.rcv.glmnet.prob                                               0.9271085
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                   0.9271085
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                         0.9271085
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.81793414
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.81804259
## Party.fctr.All.X..rcv.glmnet.prob                                         0.81803046
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.81803046
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.81803046
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.81803046
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.81803046
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.81803046
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.6823338
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.6823105
## Party.fctr.All.X..rcv.glmnet.prob                                         0.6824249
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.6824249
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.6824249
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.6824249
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.6824249
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.6824249
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                              0.4752093
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                               0.4751697
## Party.fctr.All.X..rcv.glmnet.prob                                                        0.4752537
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                            0.4752537
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                   0.4752537
## Party.fctr.All.X.center.rcv.glmnet.prob                                                  0.4752537
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                      0.4752537
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                            0.4752537
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.5228501
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.5228551
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.5228551
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.5228551
## Party.fctr.All.X.center.rcv.glmnet.prob                                             0.5228551
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                 0.5228551
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                       0.5228551
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.5226850
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.5226685
## Party.fctr.All.X..rcv.glmnet.prob                                             0.5226792
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.5226792
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.5226792
## Party.fctr.All.X.center.rcv.glmnet.prob                                       0.5226792
## Party.fctr.All.X.zv.rcv.glmnet.prob                                           0.5226792
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                 0.5226792
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.223743171
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.223718696
## Party.fctr.All.X..rcv.glmnet.prob                                           0.223850420
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.223850420
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.223850420
## Party.fctr.All.X.center.rcv.glmnet.prob                                     0.223850420
## Party.fctr.All.X.zv.rcv.glmnet.prob                                         0.223850420
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                               0.223850420
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.7679792 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.7679792 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.7679792 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.7679792 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.7679792 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.7679792 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.7679792 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.7679792 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.7679687 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.7679609 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.7625137 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.7615228 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.7175343 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.6979323 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.6923309 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6663249 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6604631 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6366493 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6291704 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.6224747 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.6104636 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5671045 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5582249 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5028537 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4776724 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4762148 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4479517 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3994493 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1820654 
## [1] "myfit_mdl: enter: 0.001000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.28##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.685000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.494000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        2900   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        29   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 4.113000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 12.138000 secs"
##                             id
## 1 Ensemble.auto.28##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.795                 0.071
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 12.239000 secs"
## glmnet variable importance
## 
##   only 20 most important variables shown (out of 29)
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X.zv.rcv.glmnet.prob                   0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.center.scale.rcv.glmnet.prob         0.00
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob       0.00
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob            0.00
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob         0.00
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob           0.00
## Party.fctr.All.X..rcv.bagEarth.prob                   0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob            0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob          0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                           0.36218938
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                            0.36221072
## Party.fctr.All.X..rcv.glmnet.prob                                     0.36224450
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                         0.36224450
## Party.fctr.All.X.scale.rcv.glmnet.prob                                0.36224450
## Party.fctr.All.X.center.rcv.glmnet.prob                               0.36224450
## Party.fctr.All.X.zv.rcv.glmnet.prob                                   0.36224450
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                         0.36224450
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                               0.36224450
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.55888047
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.55890298
## Party.fctr.All.X..rcv.glmnet.prob                                         0.55915752
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.55915753
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.55915753
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.55915753
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.55915753
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.55915753
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                   0.55915753
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.50042634
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.50046713
## Party.fctr.All.X..rcv.glmnet.prob                                       0.50008535
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.50008535
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.50008535
## Party.fctr.All.X.center.rcv.glmnet.prob                                 0.50008535
## Party.fctr.All.X.zv.rcv.glmnet.prob                                     0.50008535
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                           0.50008535
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                 0.50008535
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.7448104
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.7449006
## Party.fctr.All.X..rcv.glmnet.prob                                       0.7448175
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.7448175
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.7448175
## Party.fctr.All.X.center.rcv.glmnet.prob                                 0.7448175
## Party.fctr.All.X.zv.rcv.glmnet.prob                                     0.7448175
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                           0.7448175
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                 0.7448175
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.7814010
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.7814371
## Party.fctr.All.X..rcv.glmnet.prob                                            0.7814906
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                0.7814906
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       0.7814906
## Party.fctr.All.X.center.rcv.glmnet.prob                                      0.7814906
## Party.fctr.All.X.zv.rcv.glmnet.prob                                          0.7814906
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                0.7814906
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                      0.7814906
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.67342431
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.67343809
## Party.fctr.All.X..rcv.glmnet.prob                                           0.67337849
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.67337849
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.67337849
## Party.fctr.All.X.center.rcv.glmnet.prob                                     0.67337849
## Party.fctr.All.X.zv.rcv.glmnet.prob                                         0.67337849
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                               0.67337849
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                     0.67337849
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                            0.66324781
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.66326077
## Party.fctr.All.X..rcv.glmnet.prob                                      0.66319583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                          0.66319583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                 0.66319583
## Party.fctr.All.X.center.rcv.glmnet.prob                                0.66319583
## Party.fctr.All.X.zv.rcv.glmnet.prob                                    0.66319583
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                          0.66319583
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                0.66319583
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.72536860
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.72541681
## Party.fctr.All.X..rcv.glmnet.prob                                               0.72541583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   0.72541583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          0.72541583
## Party.fctr.All.X.center.rcv.glmnet.prob                                         0.72541583
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             0.72541583
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                   0.72541583
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                         0.72541583
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                               0.683087856
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                                0.683096130
## Party.fctr.All.X..rcv.glmnet.prob                                                         0.683181734
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                             0.683181734
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                    0.683181734
## Party.fctr.All.X.center.rcv.glmnet.prob                                                   0.683181734
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                       0.683181734
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                             0.683181734
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                                   0.683181734
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.9999995
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9999615
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.9999615
## Party.fctr.All.X.center.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                 0.9999615
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                             0.9999615
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                           0.9999995
## Party.fctr.All.X..rcv.glmnet.prob                                                    0.9999625
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                        0.9999625
## Party.fctr.All.X.scale.rcv.glmnet.prob                                               0.9999625
## Party.fctr.All.X.center.rcv.glmnet.prob                                              0.9999625
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                  0.9999625
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                        0.9999625
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                              0.9999625
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                         1.0000000
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                              1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                    1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                                1.0000000
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                            1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                      1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                      1.0000000
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                              1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                         1.0000000
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                    1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                                1.0000000
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                              1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                     1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                              1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                    1.0000000
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.9923451
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9923540
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.9923493
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.9923493
## Party.fctr.All.X.center.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.zv.rcv.glmnet.prob                                           0.9923493
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                 0.9923493
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                       0.9923493
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                    0.9946031
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9946048
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9946489
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                  0.9946489
## Party.fctr.All.X.scale.rcv.glmnet.prob                                         0.9946489
## Party.fctr.All.X.center.rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X.zv.rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                  0.9946489
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                        0.9946489
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.8834434
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.8833991
## Party.fctr.All.X..rcv.glmnet.prob                                         0.8833465
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.8833465
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.8833465
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.8833465
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.8833465
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.8833465
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                   0.8833465
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                           0.9271877
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                            0.9271592
## Party.fctr.All.X..rcv.glmnet.prob                                                     0.9271085
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                         0.9271085
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                0.9271085
## Party.fctr.All.X.center.rcv.glmnet.prob                                               0.9271085
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                   0.9271085
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                         0.9271085
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                               0.9271085
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.81793414
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.81804259
## Party.fctr.All.X..rcv.glmnet.prob                                         0.81803046
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.81803046
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.81803046
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.81803046
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.81803046
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.81803046
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                   0.81803046
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.6823338
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.6823105
## Party.fctr.All.X..rcv.glmnet.prob                                         0.6824249
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.6824249
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.6824249
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.6824249
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.6824249
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.6824249
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                   0.6824249
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                              0.4752093
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                               0.4751697
## Party.fctr.All.X..rcv.glmnet.prob                                                        0.4752537
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                            0.4752537
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                   0.4752537
## Party.fctr.All.X.center.rcv.glmnet.prob                                                  0.4752537
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                      0.4752537
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                            0.4752537
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                                  0.4752537
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.5228501
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.5228551
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.5228551
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.5228551
## Party.fctr.All.X.center.rcv.glmnet.prob                                             0.5228551
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                 0.5228551
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                       0.5228551
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                             0.5228551
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.5226850
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.5226685
## Party.fctr.All.X..rcv.glmnet.prob                                             0.5226792
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.5226792
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.5226792
## Party.fctr.All.X.center.rcv.glmnet.prob                                       0.5226792
## Party.fctr.All.X.zv.rcv.glmnet.prob                                           0.5226792
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                 0.5226792
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                       0.5226792
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.223743171
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.223718696
## Party.fctr.All.X..rcv.glmnet.prob                                           0.223850420
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.223850420
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.223850420
## Party.fctr.All.X.center.rcv.glmnet.prob                                     0.223850420
## Party.fctr.All.X.zv.rcv.glmnet.prob                                         0.223850420
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                               0.223850420
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                     0.223850420
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.7762657 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.7762657 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.7762657 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.7762657 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.7762657 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.7762657 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.7762657 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.7762657 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.7762542 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.7762467 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.7707221 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.7698488 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.7250191 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.7009165 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.6991529 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6691282 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6627828 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6379611 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6303856 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.6294589 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.6130607 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5712231 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5582582 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5027549 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4792860 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4778742 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4489268 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3981205 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1835577 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.29##rcv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.684000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.599000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        3000   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        30   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 4.223000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 12.258000 secs"
##                             id
## 1 Ensemble.auto.29##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                        2.9                 0.073
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0008615748     0.001732806
## [1] "myfit_mdl: exit: 12.362000 secs"
## glmnet variable importance
## 
##   only 20 most important variables shown (out of 30)
## 
##                                                    Overall
## Party.fctr.All.X..rcv.rf.prob                       100.00
## Party.fctr.All.X..rcv.avNNet.prob                    37.32
## .rnorm                                                0.00
## Party.fctr.All.X..rcv.earth.prob                      0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob               0.00
## Party.fctr.All.X..rcv.nnet.prob                       0.00
## Party.fctr.RFE.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.glmnet.prob                     0.00
## Party.fctr.All.X.center.scale.rcv.glmnet.prob         0.00
## Party.fctr.All.X.zv.rcv.glmnet.prob                   0.00
## Party.fctr.Max.cor.Y..rcv.rpart.prob                  0.00
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob         0.00
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob           0.00
## Party.fctr.All.X..rcv.bagEarth.prob                   0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob            0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                  0.00
## Party.fctr.All.X..rcv.rpart.prob                      0.00
## Party.fctr.All.X.scale.rcv.glmnet.prob                0.00
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob    0.00
##                                                    Party.fctr.All.X..rcv.rf.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.44434961
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.05594012
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                            0.18691638
## Party.fctr.All.X..rcv.rf.prob                                         1.00000000
## Party.fctr.RFE.X..rcv.glmnet.prob                                     0.30485184
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                       0.22206127
## Party.fctr.All.X..rcv.nnet.prob                                       0.58287547
## Party.fctr.All.X..rcv.rpart.prob                                      0.26899754
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                  0.18355099
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                    0.37640536
## Party.fctr.All.X..rcv.avNNet.prob                                     0.82103138
## Party.fctr.All.X..rcv.earth.prob                                      0.33123230
## Party.fctr.All.X..rcv.glm.prob                                        0.48341240
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                          0.33644872
## Party.fctr.All.X..rcv.bayesglm.prob                                   0.48425376
## Party.fctr.All.X..rcv.gbm.prob                                        0.59169058
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                 0.35698959
## Party.fctr.All.X..rcv.bagEarth.prob                                   0.50067692
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.35557885
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                           0.36218938
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                            0.36221072
## Party.fctr.All.X..rcv.glmnet.prob                                     0.36224450
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                         0.36224450
## Party.fctr.All.X.scale.rcv.glmnet.prob                                0.36224450
## Party.fctr.All.X.center.rcv.glmnet.prob                               0.36224450
## Party.fctr.All.X.zv.rcv.glmnet.prob                                   0.36224450
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                         0.36224450
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                               0.36224450
## Party.fctr.All.X.range.rcv.glmnet.prob                                0.36224450
##                                                    Party.fctr.All.X..rcv.avNNet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.67165059
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.05918291
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.29307602
## Party.fctr.All.X..rcv.rf.prob                                             0.82103138
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.48686609
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.31214569
## Party.fctr.All.X..rcv.nnet.prob                                           0.70883910
## Party.fctr.All.X..rcv.rpart.prob                                          0.38646593
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.28161821
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.58265851
## Party.fctr.All.X..rcv.avNNet.prob                                         1.00000000
## Party.fctr.All.X..rcv.earth.prob                                          0.50915042
## Party.fctr.All.X..rcv.glm.prob                                            0.71224351
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.51224458
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.71659152
## Party.fctr.All.X..rcv.gbm.prob                                            0.72230820
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.55476686
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.71598474
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.55251960
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.55888047
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.55890298
## Party.fctr.All.X..rcv.glmnet.prob                                         0.55915752
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.55915753
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.55915753
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.55915753
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.55915753
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.55915753
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                   0.55915753
## Party.fctr.All.X.range.rcv.glmnet.prob                                    0.55915753
##                                                    Party.fctr.All.X..rcv.nnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.63424421
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.04892984
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.22802575
## Party.fctr.All.X..rcv.rf.prob                                           0.58287547
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.42139834
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.26249036
## Party.fctr.All.X..rcv.nnet.prob                                         1.00000000
## Party.fctr.All.X..rcv.rpart.prob                                        0.34105280
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.22119074
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.54883471
## Party.fctr.All.X..rcv.avNNet.prob                                       0.70883910
## Party.fctr.All.X..rcv.earth.prob                                        0.45048273
## Party.fctr.All.X..rcv.glm.prob                                          0.69504066
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.44741873
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.69744545
## Party.fctr.All.X..rcv.gbm.prob                                          0.65218289
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.49189536
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.65339698
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.48990118
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.50042634
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.50046713
## Party.fctr.All.X..rcv.glmnet.prob                                       0.50008535
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.50008535
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.50008535
## Party.fctr.All.X.center.rcv.glmnet.prob                                 0.50008535
## Party.fctr.All.X.zv.rcv.glmnet.prob                                     0.50008535
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                           0.50008535
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                 0.50008535
## Party.fctr.All.X.range.rcv.glmnet.prob                                  0.50008535
##                                                    Party.fctr.All.X..rcv.gbm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.8082867
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.1036913
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                              0.3723600
## Party.fctr.All.X..rcv.rf.prob                                           0.5916906
## Party.fctr.RFE.X..rcv.glmnet.prob                                       0.6257192
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                         0.3721555
## Party.fctr.All.X..rcv.nnet.prob                                         0.6521829
## Party.fctr.All.X..rcv.rpart.prob                                        0.5046595
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                    0.3603659
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                      0.7028339
## Party.fctr.All.X..rcv.avNNet.prob                                       0.7223082
## Party.fctr.All.X..rcv.earth.prob                                        0.6812688
## Party.fctr.All.X..rcv.glm.prob                                          0.7833034
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                            0.6535991
## Party.fctr.All.X..rcv.bayesglm.prob                                     0.7923436
## Party.fctr.All.X..rcv.gbm.prob                                          1.0000000
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                   0.7357435
## Party.fctr.All.X..rcv.bagEarth.prob                                     0.8389531
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.7306909
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                             0.7448104
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.7449006
## Party.fctr.All.X..rcv.glmnet.prob                                       0.7448175
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                           0.7448175
## Party.fctr.All.X.scale.rcv.glmnet.prob                                  0.7448175
## Party.fctr.All.X.center.rcv.glmnet.prob                                 0.7448175
## Party.fctr.All.X.zv.rcv.glmnet.prob                                     0.7448175
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                           0.7448175
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                 0.7448175
## Party.fctr.All.X.range.rcv.glmnet.prob                                  0.7448175
##                                                    Party.fctr.All.X..rcv.bagEarth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.8911800
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.1089841
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.3953001
## Party.fctr.All.X..rcv.rf.prob                                                0.5006769
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.6248532
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4259955
## Party.fctr.All.X..rcv.nnet.prob                                              0.6533970
## Party.fctr.All.X..rcv.rpart.prob                                             0.5048896
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.3857298
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.7580066
## Party.fctr.All.X..rcv.avNNet.prob                                            0.7159847
## Party.fctr.All.X..rcv.earth.prob                                             0.7441872
## Party.fctr.All.X..rcv.glm.prob                                               0.9061252
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.6895338
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.9140335
## Party.fctr.All.X..rcv.gbm.prob                                               0.8389531
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.7670488
## Party.fctr.All.X..rcv.bagEarth.prob                                          1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.7675109
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.7814010
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.7814371
## Party.fctr.All.X..rcv.glmnet.prob                                            0.7814906
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                0.7814906
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       0.7814906
## Party.fctr.All.X.center.rcv.glmnet.prob                                      0.7814906
## Party.fctr.All.X.zv.rcv.glmnet.prob                                          0.7814906
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                0.7814906
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                      0.7814906
## Party.fctr.All.X.range.rcv.glmnet.prob                                       0.7814906
##                                                    Party.fctr.All.X..rcv.bayesglm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.88282772
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.09599784
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.31711659
## Party.fctr.All.X..rcv.rf.prob                                               0.48425376
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.54200810
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.35293404
## Party.fctr.All.X..rcv.nnet.prob                                             0.69744545
## Party.fctr.All.X..rcv.rpart.prob                                            0.42097008
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.30844338
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                          0.73644455
## Party.fctr.All.X..rcv.avNNet.prob                                           0.71659152
## Party.fctr.All.X..rcv.earth.prob                                            0.63810738
## Party.fctr.All.X..rcv.glm.prob                                              0.99889858
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.58416282
## Party.fctr.All.X..rcv.bayesglm.prob                                         1.00000000
## Party.fctr.All.X..rcv.gbm.prob                                              0.79234357
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.66197687
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.91403349
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.65784245
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.67342431
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.67343809
## Party.fctr.All.X..rcv.glmnet.prob                                           0.67337849
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.67337849
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.67337849
## Party.fctr.All.X.center.rcv.glmnet.prob                                     0.67337849
## Party.fctr.All.X.zv.rcv.glmnet.prob                                         0.67337849
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                               0.67337849
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                     0.67337849
## Party.fctr.All.X.range.rcv.glmnet.prob                                      0.67337849
##                                                    Party.fctr.All.X..rcv.glm.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.87238630
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.09460921
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                             0.31052585
## Party.fctr.All.X..rcv.rf.prob                                          0.48341240
## Party.fctr.RFE.X..rcv.glmnet.prob                                      0.53232338
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                        0.34606011
## Party.fctr.All.X..rcv.nnet.prob                                        0.69504066
## Party.fctr.All.X..rcv.rpart.prob                                       0.41412901
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                   0.30232318
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                     0.72677167
## Party.fctr.All.X..rcv.avNNet.prob                                      0.71224351
## Party.fctr.All.X..rcv.earth.prob                                       0.62951342
## Party.fctr.All.X..rcv.glm.prob                                         1.00000000
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                           0.57507376
## Party.fctr.All.X..rcv.bayesglm.prob                                    0.99889858
## Party.fctr.All.X..rcv.gbm.prob                                         0.78330340
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                  0.65178982
## Party.fctr.All.X..rcv.bagEarth.prob                                    0.90612520
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.64738779
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                            0.66324781
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.66326077
## Party.fctr.All.X..rcv.glmnet.prob                                      0.66319583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                          0.66319583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                 0.66319583
## Party.fctr.All.X.center.rcv.glmnet.prob                                0.66319583
## Party.fctr.All.X.zv.rcv.glmnet.prob                                    0.66319583
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                          0.66319583
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                0.66319583
## Party.fctr.All.X.range.rcv.glmnet.prob                                 0.66319583
##                                                    Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         1.00000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.06921113
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.37086950
## Party.fctr.All.X..rcv.rf.prob                                                   0.44434961
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.59075182
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.39360723
## Party.fctr.All.X..rcv.nnet.prob                                                 0.63424421
## Party.fctr.All.X..rcv.rpart.prob                                                0.46496974
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.35388921
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.85235576
## Party.fctr.All.X..rcv.avNNet.prob                                               0.67165059
## Party.fctr.All.X..rcv.earth.prob                                                0.67006506
## Party.fctr.All.X..rcv.glm.prob                                                  0.87238630
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.63088912
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.88282772
## Party.fctr.All.X..rcv.gbm.prob                                                  0.80828671
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.71532332
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.89118004
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.71236524
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.72536860
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.72541681
## Party.fctr.All.X..rcv.glmnet.prob                                               0.72541583
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   0.72541583
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          0.72541583
## Party.fctr.All.X.center.rcv.glmnet.prob                                         0.72541583
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             0.72541583
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                   0.72541583
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                         0.72541583
## Party.fctr.All.X.range.rcv.glmnet.prob                                          0.72541583
##                                                    Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                   0.852355765
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     -0.009567133
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                                0.380507275
## Party.fctr.All.X..rcv.rf.prob                                                             0.376405358
## Party.fctr.RFE.X..rcv.glmnet.prob                                                         0.613182343
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                           0.381804540
## Party.fctr.All.X..rcv.nnet.prob                                                           0.548834711
## Party.fctr.All.X..rcv.rpart.prob                                                          0.478386763
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                      0.352759329
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                        1.000000000
## Party.fctr.All.X..rcv.avNNet.prob                                                         0.582658505
## Party.fctr.All.X..rcv.earth.prob                                                          0.608517454
## Party.fctr.All.X..rcv.glm.prob                                                            0.726771671
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                              0.581352736
## Party.fctr.All.X..rcv.bayesglm.prob                                                       0.736444552
## Party.fctr.All.X..rcv.gbm.prob                                                            0.702833931
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                     0.674448549
## Party.fctr.All.X..rcv.bagEarth.prob                                                       0.758006626
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                      0.671540413
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                               0.683087856
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                                0.683096130
## Party.fctr.All.X..rcv.glmnet.prob                                                         0.683181734
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                             0.683181734
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                    0.683181734
## Party.fctr.All.X.center.rcv.glmnet.prob                                                   0.683181734
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                       0.683181734
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                             0.683181734
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                                   0.683181734
## Party.fctr.All.X.range.rcv.glmnet.prob                                                    0.683181734
##                                                    Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.7254168
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.2237187
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.rf.prob                                                       0.3622107
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.8180426
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.4751697
## Party.fctr.All.X..rcv.nnet.prob                                                     0.5004671
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6823105
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.5226685
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.6830961
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.5589030
## Party.fctr.All.X..rcv.earth.prob                                                    0.8833991
## Party.fctr.All.X..rcv.glm.prob                                                      0.6632608
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.9271592
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.6734381
## Party.fctr.All.X..rcv.gbm.prob                                                      0.7449006
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.9946048
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.7814371
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9923540
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.9999995
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9999615
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.9999615
## Party.fctr.All.X.center.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                 0.9999615
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X.range.rcv.glmnet.prob                                              0.9999615
##                                                    Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                              0.7253686
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                 0.2237432
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                           0.5228501
## Party.fctr.All.X..rcv.rf.prob                                                        0.3621894
## Party.fctr.RFE.X..rcv.glmnet.prob                                                    0.8179341
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                      0.4752093
## Party.fctr.All.X..rcv.nnet.prob                                                      0.5004263
## Party.fctr.All.X..rcv.rpart.prob                                                     0.6823338
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                 0.5226850
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                   0.6830879
## Party.fctr.All.X..rcv.avNNet.prob                                                    0.5588805
## Party.fctr.All.X..rcv.earth.prob                                                     0.8834434
## Party.fctr.All.X..rcv.glm.prob                                                       0.6632478
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                         0.9271877
## Party.fctr.All.X..rcv.bayesglm.prob                                                  0.6734243
## Party.fctr.All.X..rcv.gbm.prob                                                       0.7448104
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                0.9946031
## Party.fctr.All.X..rcv.bagEarth.prob                                                  0.7814010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                 0.9923451
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                           0.9999995
## Party.fctr.All.X..rcv.glmnet.prob                                                    0.9999625
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                        0.9999625
## Party.fctr.All.X.scale.rcv.glmnet.prob                                               0.9999625
## Party.fctr.All.X.center.rcv.glmnet.prob                                              0.9999625
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                  0.9999625
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                        0.9999625
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                              0.9999625
## Party.fctr.All.X.range.rcv.glmnet.prob                                               0.9999625
##                                                    Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                              1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                           1.0000000
##                                                    Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                    1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                                 1.0000000
##                                                    Party.fctr.All.X.zv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                   0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                            0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                              0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                              0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                             0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                         0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                           0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                            0.5591575
## Party.fctr.All.X..rcv.earth.prob                                             0.8833465
## Party.fctr.All.X..rcv.glm.prob                                               0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                 0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                          0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                               0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                          0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                         0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                  0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                            1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                       1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                      1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                      1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                       1.0000000
##                                                    Party.fctr.All.X.center.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                          0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                             0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                       0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                    0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                  0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                  0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                 0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                             0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                               0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                 0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                   0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                     0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                              0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                   0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                              0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                      0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                       0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                           1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                              1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                           1.0000000
##                                                    Party.fctr.All.X.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                      0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                   0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                               0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                 0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                 0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                            0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                              0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                               0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                  0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                    0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                             0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                  0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                           0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                             0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                     0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                               1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                             1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                          1.0000000
##                                                    Party.fctr.All.X.center.scale.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                   0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                             0.5228551
## Party.fctr.All.X..rcv.rf.prob                                                          0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                                      0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                        0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                                        0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                                       0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                   0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                     0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                                      0.5591575
## Party.fctr.All.X..rcv.earth.prob                                                       0.8833465
## Party.fctr.All.X..rcv.glm.prob                                                         0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                           0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                                    0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                                         0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                  0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                                    0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                   0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                            0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                             0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                                      1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                 1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                    1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                                1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                                 1.0000000
##                                                    Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.7254158
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.2238504
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                 0.5228551
## Party.fctr.All.X..rcv.rf.prob                                              0.3622445
## Party.fctr.RFE.X..rcv.glmnet.prob                                          0.8180305
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                            0.4752537
## Party.fctr.All.X..rcv.nnet.prob                                            0.5000854
## Party.fctr.All.X..rcv.rpart.prob                                           0.6824249
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                       0.5226792
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         0.6831817
## Party.fctr.All.X..rcv.avNNet.prob                                          0.5591575
## Party.fctr.All.X..rcv.earth.prob                                           0.8833465
## Party.fctr.All.X..rcv.glm.prob                                             0.6631958
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                               0.9271085
## Party.fctr.All.X..rcv.bayesglm.prob                                        0.6733785
## Party.fctr.All.X..rcv.gbm.prob                                             0.7448175
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                      0.9946489
## Party.fctr.All.X..rcv.bagEarth.prob                                        0.7814906
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                0.9999625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9999615
## Party.fctr.All.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                              1.0000000
## Party.fctr.All.X.scale.rcv.glmnet.prob                                     1.0000000
## Party.fctr.All.X.center.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.zv.rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                              1.0000000
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                     1.0000000
##                                                    Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.7123652
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2192433
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.5292805
## Party.fctr.All.X..rcv.rf.prob                                                 0.3555789
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.8241202
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.4795723
## Party.fctr.All.X..rcv.nnet.prob                                               0.4899012
## Party.fctr.All.X..rcv.rpart.prob                                              0.6869501
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          0.5292464
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.6715404
## Party.fctr.All.X..rcv.avNNet.prob                                             0.5525196
## Party.fctr.All.X..rcv.earth.prob                                              0.8768761
## Party.fctr.All.X..rcv.glm.prob                                                0.6473878
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.9319493
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.6578425
## Party.fctr.All.X..rcv.gbm.prob                                                0.7306909
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.9865002
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.7675109
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.9923451
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9923540
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9923493
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.9923493
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.9923493
## Party.fctr.All.X.center.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.zv.rcv.glmnet.prob                                           0.9923493
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                 0.9923493
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                       0.9923493
## Party.fctr.All.X.range.rcv.glmnet.prob                                        0.9923493
##                                                    Party.fctr.Low.cor.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.7153233
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2155047
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                     0.5252550
## Party.fctr.All.X..rcv.rf.prob                                                  0.3569896
## Party.fctr.RFE.X..rcv.glmnet.prob                                              0.8209720
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                0.4366224
## Party.fctr.All.X..rcv.nnet.prob                                                0.4918954
## Party.fctr.All.X..rcv.rpart.prob                                               0.6830104
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                           0.5249946
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                             0.6744485
## Party.fctr.All.X..rcv.avNNet.prob                                              0.5547669
## Party.fctr.All.X..rcv.earth.prob                                               0.8689877
## Party.fctr.All.X..rcv.glm.prob                                                 0.6517898
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                   0.9321857
## Party.fctr.All.X..rcv.bayesglm.prob                                            0.6619769
## Party.fctr.All.X..rcv.gbm.prob                                                 0.7357435
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bagEarth.prob                                            0.7670488
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9865002
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                    0.9946031
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9946048
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9946489
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                  0.9946489
## Party.fctr.All.X.scale.rcv.glmnet.prob                                         0.9946489
## Party.fctr.All.X.center.rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X.zv.rcv.glmnet.prob                                            0.9946489
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                  0.9946489
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                        0.9946489
## Party.fctr.All.X.range.rcv.glmnet.prob                                         0.9946489
##                                                    Party.fctr.All.X..rcv.earth.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.6700651
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1420945
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.4774014
## Party.fctr.All.X..rcv.rf.prob                                             0.3312323
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.6556800
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4471574
## Party.fctr.All.X..rcv.nnet.prob                                           0.4504827
## Party.fctr.All.X..rcv.rpart.prob                                          0.6121520
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.4683211
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.6085175
## Party.fctr.All.X..rcv.avNNet.prob                                         0.5091504
## Party.fctr.All.X..rcv.earth.prob                                          1.0000000
## Party.fctr.All.X..rcv.glm.prob                                            0.6295134
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.8148176
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.6381074
## Party.fctr.All.X..rcv.gbm.prob                                            0.6812688
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.8689877
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.7441872
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.8768761
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.8834434
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.8833991
## Party.fctr.All.X..rcv.glmnet.prob                                         0.8833465
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.8833465
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.8833465
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.8833465
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.8833465
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.8833465
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                   0.8833465
## Party.fctr.All.X.range.rcv.glmnet.prob                                    0.8833465
##                                                    Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                               0.6308891
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                  0.2234457
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                            0.5708480
## Party.fctr.All.X..rcv.rf.prob                                                         0.3364487
## Party.fctr.RFE.X..rcv.glmnet.prob                                                     0.7602901
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                       0.4687519
## Party.fctr.All.X..rcv.nnet.prob                                                       0.4474187
## Party.fctr.All.X..rcv.rpart.prob                                                      0.6635718
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                  0.5798453
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                    0.5813527
## Party.fctr.All.X..rcv.avNNet.prob                                                     0.5122446
## Party.fctr.All.X..rcv.earth.prob                                                      0.8148176
## Party.fctr.All.X..rcv.glm.prob                                                        0.5750738
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.bayesglm.prob                                                   0.5841628
## Party.fctr.All.X..rcv.gbm.prob                                                        0.6535991
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                 0.9321857
## Party.fctr.All.X..rcv.bagEarth.prob                                                   0.6895338
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                  0.9319493
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                           0.9271877
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                            0.9271592
## Party.fctr.All.X..rcv.glmnet.prob                                                     0.9271085
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                         0.9271085
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                0.9271085
## Party.fctr.All.X.center.rcv.glmnet.prob                                               0.9271085
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                   0.9271085
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                         0.9271085
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                               0.9271085
## Party.fctr.All.X.range.rcv.glmnet.prob                                                0.9271085
##                                                    Party.fctr.RFE.X..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.59075182
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.03712174
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.32079312
## Party.fctr.All.X..rcv.rf.prob                                             0.30485184
## Party.fctr.RFE.X..rcv.glmnet.prob                                         1.00000000
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.27274431
## Party.fctr.All.X..rcv.nnet.prob                                           0.42139834
## Party.fctr.All.X..rcv.rpart.prob                                          0.52072087
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.30826132
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.61318234
## Party.fctr.All.X..rcv.avNNet.prob                                         0.48686609
## Party.fctr.All.X..rcv.earth.prob                                          0.65568002
## Party.fctr.All.X..rcv.glm.prob                                            0.53232338
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.76029008
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.54200810
## Party.fctr.All.X..rcv.gbm.prob                                            0.62571918
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.82097196
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.62485318
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.82412022
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.81793414
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.81804259
## Party.fctr.All.X..rcv.glmnet.prob                                         0.81803046
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.81803046
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.81803046
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.81803046
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.81803046
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.81803046
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                   0.81803046
## Party.fctr.All.X.range.rcv.glmnet.prob                                    0.81803046
##                                                    Party.fctr.All.X..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.4649697
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.1956013
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                0.6071103
## Party.fctr.All.X..rcv.rf.prob                                             0.2689975
## Party.fctr.RFE.X..rcv.glmnet.prob                                         0.5207209
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                           0.4863653
## Party.fctr.All.X..rcv.nnet.prob                                           0.3410528
## Party.fctr.All.X..rcv.rpart.prob                                          1.0000000
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                      0.6126261
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                        0.4783868
## Party.fctr.All.X..rcv.avNNet.prob                                         0.3864659
## Party.fctr.All.X..rcv.earth.prob                                          0.6121520
## Party.fctr.All.X..rcv.glm.prob                                            0.4141290
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                              0.6635718
## Party.fctr.All.X..rcv.bayesglm.prob                                       0.4209701
## Party.fctr.All.X..rcv.gbm.prob                                            0.5046595
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                     0.6830104
## Party.fctr.All.X..rcv.bagEarth.prob                                       0.5048896
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.6869501
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                               0.6823338
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.6823105
## Party.fctr.All.X..rcv.glmnet.prob                                         0.6824249
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                             0.6824249
## Party.fctr.All.X.scale.rcv.glmnet.prob                                    0.6824249
## Party.fctr.All.X.center.rcv.glmnet.prob                                   0.6824249
## Party.fctr.All.X.zv.rcv.glmnet.prob                                       0.6824249
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                             0.6824249
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                   0.6824249
## Party.fctr.All.X.range.rcv.glmnet.prob                                    0.6824249
##                                                    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                  0.3936072
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                     0.1475638
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                               0.7560218
## Party.fctr.All.X..rcv.rf.prob                                                            0.2220613
## Party.fctr.RFE.X..rcv.glmnet.prob                                                        0.2727443
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.nnet.prob                                                          0.2624904
## Party.fctr.All.X..rcv.rpart.prob                                                         0.4863653
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                     0.7287406
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                       0.3818045
## Party.fctr.All.X..rcv.avNNet.prob                                                        0.3121457
## Party.fctr.All.X..rcv.earth.prob                                                         0.4471574
## Party.fctr.All.X..rcv.glm.prob                                                           0.3460601
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                             0.4687519
## Party.fctr.All.X..rcv.bayesglm.prob                                                      0.3529340
## Party.fctr.All.X..rcv.gbm.prob                                                           0.3721555
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                                    0.4366224
## Party.fctr.All.X..rcv.bagEarth.prob                                                      0.4259955
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                     0.4795723
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                              0.4752093
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                               0.4751697
## Party.fctr.All.X..rcv.glmnet.prob                                                        0.4752537
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                            0.4752537
## Party.fctr.All.X.scale.rcv.glmnet.prob                                                   0.4752537
## Party.fctr.All.X.center.rcv.glmnet.prob                                                  0.4752537
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                      0.4752537
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                            0.4752537
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                                  0.4752537
## Party.fctr.All.X.range.rcv.glmnet.prob                                                   0.4752537
##                                                    Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.3708695
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.1080593
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                          1.0000000
## Party.fctr.All.X..rcv.rf.prob                                                       0.1869164
## Party.fctr.RFE.X..rcv.glmnet.prob                                                   0.3207931
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                                     0.7560218
## Party.fctr.All.X..rcv.nnet.prob                                                     0.2280258
## Party.fctr.All.X..rcv.rpart.prob                                                    0.6071103
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                                0.9648766
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                                  0.3805073
## Party.fctr.All.X..rcv.avNNet.prob                                                   0.2930760
## Party.fctr.All.X..rcv.earth.prob                                                    0.4774014
## Party.fctr.All.X..rcv.glm.prob                                                      0.3105258
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                        0.5708480
## Party.fctr.All.X..rcv.bayesglm.prob                                                 0.3171166
## Party.fctr.All.X..rcv.gbm.prob                                                      0.3723600
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                               0.5252550
## Party.fctr.All.X..rcv.bagEarth.prob                                                 0.3953001
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.5292805
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                         0.5228501
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.5228300
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.5228551
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                       0.5228551
## Party.fctr.All.X.scale.rcv.glmnet.prob                                              0.5228551
## Party.fctr.All.X.center.rcv.glmnet.prob                                             0.5228551
## Party.fctr.All.X.zv.rcv.glmnet.prob                                                 0.5228551
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                       0.5228551
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                             0.5228551
## Party.fctr.All.X.range.rcv.glmnet.prob                                              0.5228551
##                                                    Party.fctr.Max.cor.Y..rcv.rpart.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.3538892
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2095866
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                    0.9648766
## Party.fctr.All.X..rcv.rf.prob                                                 0.1835510
## Party.fctr.RFE.X..rcv.glmnet.prob                                             0.3082613
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                               0.7287406
## Party.fctr.All.X..rcv.nnet.prob                                               0.2211907
## Party.fctr.All.X..rcv.rpart.prob                                              0.6126261
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                          1.0000000
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                            0.3527593
## Party.fctr.All.X..rcv.avNNet.prob                                             0.2816182
## Party.fctr.All.X..rcv.earth.prob                                              0.4683211
## Party.fctr.All.X..rcv.glm.prob                                                0.3023232
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                  0.5798453
## Party.fctr.All.X..rcv.bayesglm.prob                                           0.3084434
## Party.fctr.All.X..rcv.gbm.prob                                                0.3603659
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                         0.5249946
## Party.fctr.All.X..rcv.bagEarth.prob                                           0.3857298
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.5292464
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                   0.5226850
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.5226685
## Party.fctr.All.X..rcv.glmnet.prob                                             0.5226792
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                                 0.5226792
## Party.fctr.All.X.scale.rcv.glmnet.prob                                        0.5226792
## Party.fctr.All.X.center.rcv.glmnet.prob                                       0.5226792
## Party.fctr.All.X.zv.rcv.glmnet.prob                                           0.5226792
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                                 0.5226792
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                       0.5226792
## Party.fctr.All.X.range.rcv.glmnet.prob                                        0.5226792
##                                                    Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.069211125
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.000000000
## Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob                                  0.108059255
## Party.fctr.All.X..rcv.rf.prob                                               0.055940119
## Party.fctr.RFE.X..rcv.glmnet.prob                                           0.037121740
## Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob                             0.147563788
## Party.fctr.All.X..rcv.nnet.prob                                             0.048929835
## Party.fctr.All.X..rcv.rpart.prob                                            0.195601286
## Party.fctr.Max.cor.Y..rcv.rpart.prob                                        0.209586621
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob                         -0.009567133
## Party.fctr.All.X..rcv.avNNet.prob                                           0.059182907
## Party.fctr.All.X..rcv.earth.prob                                            0.142094538
## Party.fctr.All.X..rcv.glm.prob                                              0.094609212
## Party.fctr.All.X.spatialSign.rcv.glmnet.prob                                0.223445660
## Party.fctr.All.X..rcv.bayesglm.prob                                         0.095997840
## Party.fctr.All.X..rcv.gbm.prob                                              0.103691321
## Party.fctr.Low.cor.X..rcv.glmnet.prob                                       0.215504670
## Party.fctr.All.X..rcv.bagEarth.prob                                         0.108984097
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.219243275
## Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob                                 0.223743171
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.223718696
## Party.fctr.All.X..rcv.glmnet.prob                                           0.223850420
## Party.fctr.All.X.center.scale.rcv.glmnet.prob                               0.223850420
## Party.fctr.All.X.scale.rcv.glmnet.prob                                      0.223850420
## Party.fctr.All.X.center.rcv.glmnet.prob                                     0.223850420
## Party.fctr.All.X.zv.rcv.glmnet.prob                                         0.223850420
## Party.fctr.All.X.conditionalX.rcv.glmnet.prob                               0.223850420
## Party.fctr.All.X.BoxCox.rcv.glmnet.prob                                     0.223850420
## Party.fctr.All.X.range.rcv.glmnet.prob                                      0.223850420
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                          0.7839806 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                          0.7839806 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                          0.7839806 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                          0.7839806 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                          0.7839806 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                          0.7839806 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                          0.7839806 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                          0.7839806 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                          0.7839682 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                          0.7839610 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                          0.7783645 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                          0.7776005 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                          0.7319877 
##                   Party.fctr.All.X..rcv.earth.prob 
##                                          0.7055044 
##                Party.fctr.All.X..rcv.bagEarth.prob 
##                                          0.7036949 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          0.6717382 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                          0.6649426 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                          0.6391824 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                          0.6359613 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                          0.6315170 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                          0.6154787 
##                   Party.fctr.All.X..rcv.rpart.prob 
##                                          0.5750577 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          0.5582892 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.5026628 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                          0.4807884 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                          0.4794192 
##    Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob 
##                                          0.4498346 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          0.3968834 
##               Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                          0.1849471 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: All.X##boot#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.712000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.913000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        3000   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        30   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.541000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.594000 secs"
##                   id
## 1 All.X##boot#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.185                 0.073
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 11.696000 secs"
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: All.X##boot632#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.681000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 3.110000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        3000   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        30   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.739000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.827000 secs"
##                      id
## 1 All.X##boot632#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.414                 0.074
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9997887
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9995751
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit max.AccuracyApparent.fit
## 1                  0               0                0.9994256
##   max.KappaApparent.fit
## 1              0.998845
## [1] "myfit_mdl: exit: 11.934000 secs"
## [1] "myfit_mdl: enter: 0.001000 secs"
## [1] "myfit_mdl: fitting model: All.X##cv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.694000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.820000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        3000   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        30   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.444000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.438000 secs"
##                 id
## 1 All.X##cv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.109                 0.073
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994263
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988459
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1       0.0009937182     0.001998895
## [1] "myfit_mdl: exit: 11.543000 secs"
## [1] "skipping fitting model: All.X##rcv#glmnet"
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: All.X##LGOCV#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.694000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.213 on full training set
## [1] "myfit_mdl: train complete: 2.866000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        3000   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        30   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.101876                          1.115379 
##     Party.fctr.All.X..rcv.rf.prob 
##                          2.988838 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.All.X..rcv.avNNet.prob 
##                         -2.234395                          1.190343 
##     Party.fctr.All.X..rcv.rf.prob 
##                          3.188620 
## [1] "myfit_mdl: train diagnostics complete: 3.488000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score  accuracy
## 9       0.40 0.99938 0.9994256
## 10      0.45 0.99938 0.9994256
## 11      0.50 0.99938 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 129 108
##         R  75 131
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58690745     0.17835751     0.53947331     0.63317324     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01582648     0.01800535 
## [1] "myfit_mdl: predict complete: 11.765000 secs"
##                    id
## 1 All.X##LGOCV#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.158                 0.073
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608       0.9999967
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938         0.999232
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855      0.998455
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.574577    0.6540084    0.4951456       0.6066527
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45        0.588764        0.5869074
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5394733             0.6331732     0.1783575
##   max.AccuracySD.fit max.KappaSD.fit
## 1          0.0013303     0.002676058
## [1] "myfit_mdl: exit: 11.872000 secs"
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: All.X##adaptive_cv#glmnet"
## [1] "    indepVar: Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.691000 secs"
## o 2 eliminated;23 remain
## o 21 models of 23 were eliminated due to linear dependencies
## o no models eliminated; 23 remain
## + Fold1.Rep3: alpha=0.1, lambda=0.04589 
## - Fold1.Rep3: alpha=0.1, lambda=0.04589 
## o no models eliminated; 2 remain
## + Fold2.Rep3: alpha=0.1, lambda=0.04589 
## - Fold2.Rep3: alpha=0.1, lambda=0.04589 
## o no models eliminated; 2 remain
## + Fold3.Rep3: alpha=0.1, lambda=0.04589 
## - Fold3.Rep3: alpha=0.1, lambda=0.04589 
## o no models eliminated; 2 remain
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.1, lambda = 0.00989 on full training set
## [1] "myfit_mdl: train complete: 5.599000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: alpha

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        3000   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        30   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                                        (Intercept) 
##                                        -3.89356081 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                         3.30549674 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                        -0.11386313 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                         1.43595777 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                        -0.03154877 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                        -0.19492118 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                         0.77675215 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                         8.78577198 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                        -0.21234914 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                        -0.20657719 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                        -0.24043129 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                        -0.24579892 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                        -0.24687873 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        -0.22778513 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        -0.29738824 
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        -0.21709308 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                        -0.22337481 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                        -0.44821768 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                        -0.98869138 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        -0.54639245 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                        -0.20638553 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                        -0.35825249 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                        -0.21096825 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                        -0.39534986 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                        -1.06852908 
## [1] "max lambda < lambdaOpt:"
##                                        (Intercept) 
##                                         -3.9378528 
##                  Party.fctr.All.X..rcv.avNNet.prob 
##                                          3.3539623 
##                Party.fctr.All.X..rcv.bayesglm.prob 
##                                         -0.1319332 
##                     Party.fctr.All.X..rcv.gbm.prob 
##                                          1.4523320 
##                     Party.fctr.All.X..rcv.glm.prob 
##                                         -0.0465089 
##                  Party.fctr.All.X..rcv.glmnet.prob 
##                                         -0.1965423 
##                    Party.fctr.All.X..rcv.nnet.prob 
##                                          0.7823387 
##                      Party.fctr.All.X..rcv.rf.prob 
##                                          9.0050065 
##            Party.fctr.All.X.BoxCox.rcv.glmnet.prob 
##                                         -0.2148063 
##        Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob 
##                                         -0.2078864 
##            Party.fctr.All.X.center.rcv.glmnet.prob 
##                                         -0.2427204 
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob 
##                                         -0.2476440 
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob 
##                                         -0.2485052 
##         Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                         -0.2283510 
##               Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                         -0.2999626 
##             Party.fctr.All.X.range.rcv.glmnet.prob 
##                                         -0.2186854 
##             Party.fctr.All.X.scale.rcv.glmnet.prob 
##                                         -0.2254159 
##       Party.fctr.All.X.spatialSign.rcv.glmnet.prob 
##                                         -0.4661904 
## Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob 
##                                         -1.0215993 
##            Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                         -0.5745642 
##                Party.fctr.All.X.zv.rcv.glmnet.prob 
##                                         -0.2083021 
##              Party.fctr.Low.cor.X..rcv.glmnet.prob 
##                                         -0.3669093 
##               Party.fctr.Max.cor.Y..rcv.rpart.prob 
##                                         -0.2199692 
##         Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob 
##                                         -0.4118597 
##                  Party.fctr.RFE.X..rcv.glmnet.prob 
##                                         -1.1069381 
## [1] "myfit_mdl: train diagnostics complete: 6.307000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold   f.score  accuracy
## 6       0.25 0.9993808 0.9994256
## 7       0.30 0.9993800 0.9994256
## 8       0.35 0.9993800 0.9994256
## 9       0.40 0.9993800 0.9994256
## 10      0.45 0.9993800 0.9994256
## 11      0.50 0.9993800 0.9994256
## 12      0.55 0.9993800 0.9994256
## 13      0.60 0.9993800 0.9994256
## 14      0.65 0.9993800 0.9994256
## 15      0.70 0.9993800 0.9994256

##          Prediction
## Reference   D   R
##         D 934   0
##         R   1 806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      0.9994256      0.9988450      0.9968039      0.9999855      0.5364733 
## AccuracyPValue  McnemarPValue 
##      0.0000000      1.0000000

##          Prediction
## Reference   D   R
##         D 139  98
##         R  84 122
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##     0.58916479     0.17794001     0.54175284     0.63537801     0.53498871 
## AccuracyPValue  McnemarPValue 
##     0.01239251     0.33523441 
## [1] "myfit_mdl: predict complete: 16.503000 secs"
##                          id
## 1 All.X##adaptive_cv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             feats
## 1 Party.fctr.All.X.zv.pca.rcv.glmnet.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob,Party.fctr.All.X..rcv.rf.prob,Party.fctr.RFE.X..rcv.glmnet.prob,Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob,Party.fctr.All.X..rcv.nnet.prob,Party.fctr.All.X..rcv.rpart.prob,Party.fctr.Max.cor.Y..rcv.rpart.prob,Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.earth.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X..rcv.bayesglm.prob,Party.fctr.All.X..rcv.gbm.prob,Party.fctr.Low.cor.X..rcv.glmnet.prob,Party.fctr.All.X..rcv.bagEarth.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.center.scale.rcv.glmnet.prob,Party.fctr.All.X.scale.rcv.glmnet.prob,Party.fctr.All.X.center.rcv.glmnet.prob,Party.fctr.All.X.zv.rcv.glmnet.prob,Party.fctr.All.X.conditionalX.rcv.glmnet.prob,Party.fctr.All.X.BoxCox.rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      4.892                 0.126
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.9993804            1    0.9987608               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5         0.99938        0.9994256
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9968039             0.9999855     0.9988448
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5777518    0.6118143    0.5436893       0.5972512
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.45         0.57277        0.5891648
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5417528              0.635378       0.17794
##   max.AccuracySD.fit max.KappaSD.fit max..B.fit
## 1       0.0008615748     0.001732806          9
## [1] "myfit_mdl: exit: 16.618000 secs"

## glmnet 
## 
## 1741 samples
##  108 predictor
##    2 classes: 'D', 'R' 
## 
## Pre-processing: principal component signal extraction (263),
##  centered (263), scaled (263), remove (4) 
## Resampling: Cross-Validated (3 fold, repeated 3 times) 
## Summary of sample sizes: 1161, 1160, 1161, 1161, 1160, 1161, ... 
## Resampling results across tuning parameters:
## 
##   alpha  lambda        Accuracy   Kappa     
##   0.100  4.831424e-05  0.5646141  0.12053216
##   0.100  2.242548e-04  0.5646141  0.12053216
##   0.100  1.040899e-03  0.5646141  0.12053216
##   0.100  4.831424e-03  0.5648047  0.12069765
##   0.100  2.242548e-02  0.5686312  0.12610527
##   0.325  4.831424e-05  0.5646145  0.12058463
##   0.325  2.242548e-04  0.5646145  0.12058463
##   0.325  1.040899e-03  0.5646141  0.12058350
##   0.325  4.831424e-03  0.5671016  0.12474824
##   0.325  2.242548e-02  0.5684373  0.12310831
##   0.550  4.831424e-05  0.5642313  0.11985724
##   0.550  2.242548e-04  0.5642313  0.11985724
##   0.550  1.040899e-03  0.5659541  0.12316888
##   0.550  4.831424e-03  0.5676743  0.12499089
##   0.550  2.242548e-02  0.5663277  0.11357163
##   0.775  4.831424e-05  0.5644229  0.12022091
##   0.775  2.242548e-04  0.5644229  0.12022091
##   0.775  1.040899e-03  0.5661444  0.12358209
##   0.775  4.831424e-03  0.5686295  0.12644937
##   0.775  2.242548e-02  0.5611616  0.09700507
##   1.000  4.831424e-05  0.5642313  0.11985724
##   1.000  2.242548e-04  0.5642313  0.11985991
##   1.000  1.040899e-03  0.5663363  0.12374996
##   1.000  4.831424e-03  0.5690120  0.12693372
##   1.000  2.242548e-02  0.5584819  0.08405071
## 
## Accuracy was used to select the optimal model using  the largest value.
## The final values used for the model were alpha = 1 and lambda
##  = 0.004831424.
## [1] "All.X#zv.pca#rcv#glmnet fit prediction diagnostics:"
## [1] "All.X#zv.pca#rcv#glmnet OOB prediction diagnostics:"
##       All.X.zv.pca.rcv.glmnet.imp          imp
## PC176                1.000000e+02 1.000000e+02
## PC143                9.275090e+01 9.275090e+01
## PC16                 8.520516e+01 8.520516e+01
## PC170                7.479393e+01 7.479393e+01
## PC35                 7.315796e+01 7.315796e+01
## PC144                7.010065e+01 7.010065e+01
## PC128                6.982828e+01 6.982828e+01
## PC78                 6.978608e+01 6.978608e+01
## PC130                6.950057e+01 6.950057e+01
## PC33                 6.838701e+01 6.838701e+01
## PC111                6.230038e+01 6.230038e+01
## PC110                6.055558e+01 6.055558e+01
## PC123                5.724446e+01 5.724446e+01
## PC166                5.488771e+01 5.488771e+01
## PC73                 5.291358e+01 5.291358e+01
## PC165                5.257870e+01 5.257870e+01
## PC29                 5.254738e+01 5.254738e+01
## PC20                 5.129963e+01 5.129963e+01
## PC163                5.034326e+01 5.034326e+01
## PC21                 4.988859e+01 4.988859e+01
## PC17                 4.985385e+01 4.985385e+01
## PC115                4.921876e+01 4.921876e+01
## PC106                4.872059e+01 4.872059e+01
## PC113                4.852200e+01 4.852200e+01
## PC47                 4.830536e+01 4.830536e+01
## PC14                 4.646959e+01 4.646959e+01
## PC138                4.559336e+01 4.559336e+01
## PC44                 4.445818e+01 4.445818e+01
## PC174                4.419996e+01 4.419996e+01
## PC169                4.175077e+01 4.175077e+01
## PC122                4.042866e+01 4.042866e+01
## PC27                 4.033550e+01 4.033550e+01
## PC53                 3.961769e+01 3.961769e+01
## PC168                3.922960e+01 3.922960e+01
## PC87                 3.885272e+01 3.885272e+01
## PC83                 3.881538e+01 3.881538e+01
## PC74                 3.832925e+01 3.832925e+01
## PC10                 3.822141e+01 3.822141e+01
## PC70                 3.815807e+01 3.815807e+01
## PC137                3.728419e+01 3.728419e+01
## PC155                3.706870e+01 3.706870e+01
## PC124                3.662386e+01 3.662386e+01
## PC8                  3.601150e+01 3.601150e+01
## PC147                3.586515e+01 3.586515e+01
## PC45                 3.501084e+01 3.501084e+01
## PC153                3.481962e+01 3.481962e+01
## PC6                  3.450937e+01 3.450937e+01
## PC15                 3.401918e+01 3.401918e+01
## PC11                 3.376872e+01 3.376872e+01
## PC55                 3.366349e+01 3.366349e+01
## PC9                  3.351613e+01 3.351613e+01
## PC91                 3.343727e+01 3.343727e+01
## PC89                 3.230346e+01 3.230346e+01
## PC13                 3.070796e+01 3.070796e+01
## PC180                2.996555e+01 2.996555e+01
## PC34                 2.985494e+01 2.985494e+01
## PC136                2.984962e+01 2.984962e+01
## PC7                  2.909991e+01 2.909991e+01
## PC28                 2.888611e+01 2.888611e+01
## PC154                2.783634e+01 2.783634e+01
## PC58                 2.727390e+01 2.727390e+01
## PC135                2.697665e+01 2.697665e+01
## PC75                 2.638460e+01 2.638460e+01
## PC171                2.531038e+01 2.531038e+01
## PC120                2.489996e+01 2.489996e+01
## PC146                2.488196e+01 2.488196e+01
## PC86                 2.485278e+01 2.485278e+01
## PC94                 2.450185e+01 2.450185e+01
## PC156                2.446547e+01 2.446547e+01
## PC159                2.441279e+01 2.441279e+01
## PC131                2.388039e+01 2.388039e+01
## PC145                2.367954e+01 2.367954e+01
## PC18                 2.357931e+01 2.357931e+01
## PC24                 2.329016e+01 2.329016e+01
## PC90                 2.319657e+01 2.319657e+01
## PC4                  2.088729e+01 2.088729e+01
## PC26                 2.038367e+01 2.038367e+01
## PC60                 1.935100e+01 1.935100e+01
## PC30                 1.897980e+01 1.897980e+01
## PC38                 1.838838e+01 1.838838e+01
## PC66                 1.699096e+01 1.699096e+01
## PC148                1.685374e+01 1.685374e+01
## PC98                 1.638492e+01 1.638492e+01
## PC167                1.633314e+01 1.633314e+01
## PC152                1.613821e+01 1.613821e+01
## PC117                1.613769e+01 1.613769e+01
## PC52                 1.524829e+01 1.524829e+01
## PC69                 1.487455e+01 1.487455e+01
## PC132                1.432095e+01 1.432095e+01
## PC36                 1.345465e+01 1.345465e+01
## PC112                1.338934e+01 1.338934e+01
## PC57                 1.296634e+01 1.296634e+01
## PC59                 1.263362e+01 1.263362e+01
## PC64                 1.202000e+01 1.202000e+01
## PC99                 1.130747e+01 1.130747e+01
## PC141                1.112507e+01 1.112507e+01
## PC161                1.062154e+01 1.062154e+01
## PC77                 1.028165e+01 1.028165e+01
## PC48                 1.022987e+01 1.022987e+01
## PC95                 9.695666e+00 9.695666e+00
## PC178                9.244490e+00 9.244490e+00
## PC49                 8.930977e+00 8.930977e+00
## PC2                  8.646527e+00 8.646527e+00
## PC37                 7.602710e+00 7.602710e+00
## PC79                 7.362601e+00 7.362601e+00
## PC23                 6.975107e+00 6.975107e+00
## PC102                6.930198e+00 6.930198e+00
## PC63                 6.468828e+00 6.468828e+00
## PC119                5.347449e+00 5.347449e+00
## PC19                 5.092883e+00 5.092883e+00
## PC139                4.823095e+00 4.823095e+00
## PC100                4.532840e+00 4.532840e+00
## PC1                  4.431252e+00 4.431252e+00
## PC177                4.053201e+00 4.053201e+00
## PC54                 4.050821e+00 4.050821e+00
## PC92                 3.818783e+00 3.818783e+00
## PC3                  3.679924e+00 3.679924e+00
## PC162                3.612958e+00 3.612958e+00
## PC109                2.867807e+00 2.867807e+00
## PC97                 2.642836e+00 2.642836e+00
## PC88                 1.815422e+00 1.815422e+00
## PC84                 1.476555e+00 1.476555e+00
## PC114                1.271674e+00 1.271674e+00
## PC101                1.176511e+00 1.176511e+00
## PC107                9.153527e-01 9.153527e-01
## PC142                6.509297e-01 6.509297e-01
## PC172                5.303319e-01 5.303319e-01
## PC164                1.321090e-01 1.321090e-01
## PC12                 8.425935e-03 8.425935e-03
## PC5                  0.000000e+00 0.000000e+00
## PC22                 0.000000e+00 0.000000e+00
## PC25                 0.000000e+00 0.000000e+00
## PC31                 0.000000e+00 0.000000e+00
## PC32                 0.000000e+00 0.000000e+00
## PC39                 0.000000e+00 0.000000e+00
## PC40                 0.000000e+00 0.000000e+00
## PC41                 0.000000e+00 0.000000e+00
## PC42                 0.000000e+00 0.000000e+00
## PC43                 0.000000e+00 0.000000e+00
## PC46                 0.000000e+00 0.000000e+00
## PC50                 0.000000e+00 0.000000e+00
## PC51                 0.000000e+00 0.000000e+00
## PC56                 0.000000e+00 0.000000e+00
## PC61                 0.000000e+00 0.000000e+00
## PC62                 0.000000e+00 0.000000e+00
## PC65                 0.000000e+00 0.000000e+00
## PC67                 0.000000e+00 0.000000e+00
## PC68                 0.000000e+00 0.000000e+00
## PC71                 0.000000e+00 0.000000e+00
## PC72                 0.000000e+00 0.000000e+00
## PC76                 0.000000e+00 0.000000e+00
## PC80                 0.000000e+00 0.000000e+00
## PC81                 0.000000e+00 0.000000e+00
## PC82                 0.000000e+00 0.000000e+00
## PC85                 0.000000e+00 0.000000e+00
## PC93                 0.000000e+00 0.000000e+00
## PC96                 0.000000e+00 0.000000e+00
## PC103                0.000000e+00 0.000000e+00
## PC104                0.000000e+00 0.000000e+00
## PC105                0.000000e+00 0.000000e+00
## PC108                0.000000e+00 0.000000e+00
## PC116                0.000000e+00 0.000000e+00
## PC118                0.000000e+00 0.000000e+00
## PC121                0.000000e+00 0.000000e+00
## PC125                0.000000e+00 0.000000e+00
## PC126                0.000000e+00 0.000000e+00
## PC127                0.000000e+00 0.000000e+00
## PC129                0.000000e+00 0.000000e+00
## PC133                0.000000e+00 0.000000e+00
## PC134                0.000000e+00 0.000000e+00
## PC140                0.000000e+00 0.000000e+00
## PC149                0.000000e+00 0.000000e+00
## PC150                0.000000e+00 0.000000e+00
## PC151                0.000000e+00 0.000000e+00
## PC157                0.000000e+00 0.000000e+00
## PC158                0.000000e+00 0.000000e+00
## PC160                0.000000e+00 0.000000e+00
## PC173                0.000000e+00 0.000000e+00
## PC175                0.000000e+00 0.000000e+00
## PC179                0.000000e+00 0.000000e+00
## Warning in glb_analytics_diag_plots(obs_df = glbObsOOB, mdl_id =
## glbMdlSelId, : Limiting important feature scatter plots to 5 out of 180

## Loading required package: lazyeval

## [1] "Min/Max Boundaries: "
##   USER_ID Party.fctr Party.fctr.All.X.zv.pca.rcv.glmnet
## 1    1930          R                                  R
## 2    2193          D                                  D
## 3    4842          R                                  R
## 4    6364          R                                  R
##   Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 1                               0.7914409
## 2                               0.4049701
## 3                               0.7070872
## 4                               0.9278067
##   Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs
## 1                                 0.20855915
## 2                                 0.40497006
## 3                                 0.29291280
## 4                                 0.07219328
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet
## 1                                             R
## 2                                             D
## 3                                             R
## 4                                             R
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## 1                                          0.6337565
## 2                                          0.4153054
## 3                                          0.5785823
## 4                                          0.6790098
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.is.acc
## 1                                                 TRUE
## 2                                                 TRUE
## 3                                                 TRUE
## 4                                                 TRUE
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err
## 1                                             FALSE
## 2                                             FALSE
## 3                                             FALSE
## 4                                             FALSE
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err.abs
## 1                                             0.3662435
## 2                                             0.4153054
## 3                                             0.4214177
## 4                                             0.3209902
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 1                                      R
## 2                                      D
## 3                                      R
## 4                                      R
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 1                                   0.7441043
## 2                                   0.3856901
## 3                                   0.5637812
## 4                                   0.7516256
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                          TRUE
## 2                                          TRUE
## 3                                          TRUE
## 4                                          TRUE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 1                                      FALSE
## 2                                      FALSE
## 3                                      FALSE
## 4                                      FALSE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.2558957
## 2                                      0.3856901
## 3                                      0.4362188
## 4                                      0.2483744
##   Party.fctr.All.X.expoTrans.rcv.glmnet
## 1                                     R
## 2                                     D
## 3                                     R
## 4                                     R
##   Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 1                                  0.7440383
## 2                                  0.3857384
## 3                                  0.5637644
## 4                                  0.7515465
##   Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.2559617
## 2                                     0.3857384
## 3                                     0.4362356
## 4                                     0.2484535
##   Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 1                            R                         0.7441853
## 2                            D                         0.3849327
## 3                            R                         0.5633098
## 4                            R                         0.7518776
##   Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 1                                TRUE                            FALSE
## 2                                TRUE                            FALSE
## 3                                TRUE                            FALSE
## 4                                TRUE                            FALSE
##   Party.fctr.All.X..rcv.glmnet.err.abs
## 1                            0.2558147
## 2                            0.3849327
## 3                            0.4366902
## 4                            0.2481224
##   Party.fctr.All.X.conditionalX.rcv.glmnet
## 1                                        R
## 2                                        D
## 3                                        R
## 4                                        R
##   Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 1                                     0.7441853
## 2                                     0.3849327
## 3                                     0.5633098
## 4                                     0.7518776
##   Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 1                                            TRUE
## 2                                            TRUE
## 3                                            TRUE
## 4                                            TRUE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.2558147
## 2                                        0.3849327
## 3                                        0.4366902
## 4                                        0.2481224
##   Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 1                              R                           0.7441853
## 2                              D                           0.3849327
## 3                              R                           0.5633098
## 4                              R                           0.7518776
##   Party.fctr.All.X.zv.rcv.glmnet.is.acc Party.fctr.All.X.zv.rcv.glmnet.err
## 1                                  TRUE                              FALSE
## 2                                  TRUE                              FALSE
## 3                                  TRUE                              FALSE
## 4                                  TRUE                              FALSE
##   Party.fctr.All.X.zv.rcv.glmnet.err.abs
## 1                              0.2558147
## 2                              0.3849327
## 3                              0.4366902
## 4                              0.2481224
##   Party.fctr.All.X.center.rcv.glmnet
## 1                                  R
## 2                                  D
## 3                                  R
## 4                                  R
##   Party.fctr.All.X.center.rcv.glmnet.prob
## 1                               0.7441853
## 2                               0.3849327
## 3                               0.5633098
## 4                               0.7518776
##   Party.fctr.All.X.center.rcv.glmnet.is.acc
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
##   Party.fctr.All.X.center.rcv.glmnet.err
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
##   Party.fctr.All.X.center.rcv.glmnet.err.abs
## 1                                  0.2558147
## 2                                  0.3849327
## 3                                  0.4366902
## 4                                  0.2481224
##   Party.fctr.All.X.scale.rcv.glmnet Party.fctr.All.X.scale.rcv.glmnet.prob
## 1                                 R                              0.7441853
## 2                                 D                              0.3849327
## 3                                 R                              0.5633098
## 4                                 R                              0.7518776
##   Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 1                                     TRUE
## 2                                     TRUE
## 3                                     TRUE
## 4                                     TRUE
##   Party.fctr.All.X.scale.rcv.glmnet.err
## 1                                 FALSE
## 2                                 FALSE
## 3                                 FALSE
## 4                                 FALSE
##   Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 1                                 0.2558147
## 2                                 0.3849327
## 3                                 0.4366902
## 4                                 0.2481224
##   Party.fctr.All.X.center.scale.rcv.glmnet
## 1                                        R
## 2                                        D
## 3                                        R
## 4                                        R
##   Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 1                                     0.7441853
## 2                                     0.3849327
## 3                                     0.5633098
## 4                                     0.7518776
##   Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 1                                            TRUE
## 2                                            TRUE
## 3                                            TRUE
## 4                                            TRUE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.2558147
## 2                                        0.3849327
## 3                                        0.4366902
## 4                                        0.2481224
##   Party.fctr.All.X.BoxCox.rcv.glmnet
## 1                                  R
## 2                                  D
## 3                                  R
## 4                                  R
##   Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 1                               0.7441853
## 2                               0.3849327
## 3                               0.5633098
## 4                               0.7518776
##   Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.2558147
## 2                                  0.3849327
## 3                                  0.4366902
## 4                                  0.2481224
##   Party.fctr.All.X.range.rcv.glmnet Party.fctr.All.X.range.rcv.glmnet.prob
## 1                                 R                              0.7441853
## 2                                 D                              0.3849327
## 3                                 R                              0.5633098
## 4                                 R                              0.7518776
##   Party.fctr.All.X.range.rcv.glmnet.is.acc
## 1                                     TRUE
## 2                                     TRUE
## 3                                     TRUE
## 4                                     TRUE
##   Party.fctr.All.X.range.rcv.glmnet.err
## 1                                 FALSE
## 2                                 FALSE
## 3                                 FALSE
## 4                                 FALSE
##   Party.fctr.All.X.range.rcv.glmnet.err.abs Party.fctr.All.X..rcv.gbm
## 1                                 0.2558147                         R
## 2                                 0.3849327                         R
## 3                                 0.4366902                         R
## 4                                 0.2481224                         R
##   Party.fctr.All.X..rcv.gbm.prob Party.fctr.All.X..rcv.gbm.is.acc
## 1                      0.7500198                             TRUE
## 2                      0.5000888                            FALSE
## 3                      0.5808981                             TRUE
## 4                      0.8740549                             TRUE
##   Party.fctr.All.X..rcv.gbm.err Party.fctr.All.X..rcv.gbm.err.abs
## 1                         FALSE                         0.2499802
## 2                          TRUE                         0.5000888
## 3                         FALSE                         0.4191019
## 4                         FALSE                         0.1259451
##   Party.fctr.All.X..rcv.nnet Party.fctr.All.X..rcv.nnet.prob
## 1                          R                       0.7833399
## 2                          R                       0.7831569
## 3                          R                       0.7833399
## 4                          R                       0.7833399
##   Party.fctr.All.X..rcv.nnet.is.acc Party.fctr.All.X..rcv.nnet.err
## 1                              TRUE                          FALSE
## 2                             FALSE                           TRUE
## 3                              TRUE                          FALSE
## 4                              TRUE                          FALSE
##   Party.fctr.All.X..rcv.nnet.err.abs Party.fctr.All.X..rcv.earth
## 1                          0.2166601                           R
## 2                          0.7831569                           D
## 3                          0.2166601                           R
## 4                          0.2166601                           R
##   Party.fctr.All.X..rcv.earth.prob Party.fctr.All.X..rcv.earth.is.acc
## 1                        0.9309095                               TRUE
## 2                        0.3873062                               TRUE
## 3                        0.6703027                               TRUE
## 4                        0.8552319                               TRUE
##   Party.fctr.All.X..rcv.earth.err Party.fctr.All.X..rcv.earth.err.abs
## 1                           FALSE                          0.06909054
## 2                           FALSE                          0.38730621
## 3                           FALSE                          0.32969729
## 4                           FALSE                          0.14476815
##   Party.fctr.All.X..rcv.bayesglm Party.fctr.All.X..rcv.bayesglm.prob
## 1                              R                           0.8765559
## 2                              D                           0.3508745
## 3                              R                           0.7774419
## 4                              R                           0.9837228
##   Party.fctr.All.X..rcv.bayesglm.is.acc Party.fctr.All.X..rcv.bayesglm.err
## 1                                  TRUE                              FALSE
## 2                                  TRUE                              FALSE
## 3                                  TRUE                              FALSE
## 4                                  TRUE                              FALSE
##   Party.fctr.All.X..rcv.bayesglm.err.abs Party.fctr.All.X..rcv.glm
## 1                             0.12344407                         R
## 2                             0.35087451                         D
## 3                             0.22255810                         R
## 4                             0.01627723                         R
##   Party.fctr.All.X..rcv.glm.prob Party.fctr.All.X..rcv.glm.is.acc
## 1                      0.8825518                             TRUE
## 2                      0.3513874                             TRUE
## 3                      0.7884155                             TRUE
## 4                      0.9852696                             TRUE
##   Party.fctr.All.X..rcv.glm.err Party.fctr.All.X..rcv.glm.err.abs
## 1                         FALSE                        0.11744817
## 2                         FALSE                        0.35138744
## 3                         FALSE                        0.21158446
## 4                         FALSE                        0.01473044
##   Party.fctr.All.X..rcv.bagEarth Party.fctr.All.X..rcv.bagEarth.prob
## 1                              R                           0.7954651
## 2                              D                           0.4537606
## 3                              R                           0.6967508
## 4                              R                           0.9215610
##   Party.fctr.All.X..rcv.bagEarth.is.acc Party.fctr.All.X..rcv.bagEarth.err
## 1                                  TRUE                              FALSE
## 2                                  TRUE                              FALSE
## 3                                  TRUE                              FALSE
## 4                                  TRUE                              FALSE
##   Party.fctr.All.X..rcv.bagEarth.err.abs Party.fctr.All.X.nzv.rcv.glmnet
## 1                             0.20453489                               R
## 2                             0.45376058                               D
## 3                             0.30324917                               R
## 4                             0.07843899                               R
##   Party.fctr.All.X.nzv.rcv.glmnet.prob
## 1                            0.7423360
## 2                            0.3806847
## 3                            0.5620644
## 4                            0.7519297
##   Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
##   Party.fctr.All.X.nzv.rcv.glmnet.err
## 1                               FALSE
## 2                               FALSE
## 3                               FALSE
## 4                               FALSE
##   Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.All.X..rcv.rf
## 1                               0.2576640                        R
## 2                               0.3806847                        D
## 3                               0.4379356                        R
## 4                               0.2480703                        R
##   Party.fctr.All.X..rcv.rf.prob Party.fctr.All.X..rcv.rf.is.acc
## 1                         0.570                            TRUE
## 2                         0.464                            TRUE
## 3                         0.550                            TRUE
## 4                         0.664                            TRUE
##   Party.fctr.All.X..rcv.rf.err Party.fctr.All.X..rcv.rf.err.abs
## 1                        FALSE                            0.430
## 2                        FALSE                            0.464
## 3                        FALSE                            0.450
## 4                        FALSE                            0.336
##   Party.fctr.All.X..rcv.avNNet Party.fctr.All.X..rcv.avNNet.prob
## 1                            R                         0.9823944
## 2                            R                         0.5542581
## 3                            R                         0.5637287
## 4                            R                         0.9901458
##   Party.fctr.All.X..rcv.avNNet.is.acc Party.fctr.All.X..rcv.avNNet.err
## 1                                TRUE                            FALSE
## 2                               FALSE                             TRUE
## 3                                TRUE                            FALSE
## 4                                TRUE                            FALSE
##   Party.fctr.All.X..rcv.avNNet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 1                          0.017605635                                R
## 2                          0.554258113                                D
## 3                          0.436271270                                R
## 4                          0.009854211                                R
##   Party.fctr.Low.cor.X..rcv.glmnet.prob
## 1                             0.7374728
## 2                             0.3704867
## 3                             0.5601193
## 4                             0.7489604
##   Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 1                                    TRUE
## 2                                    TRUE
## 3                                    TRUE
## 4                                    TRUE
##   Party.fctr.Low.cor.X..rcv.glmnet.err
## 1                                FALSE
## 2                                FALSE
## 3                                FALSE
## 4                                FALSE
##   Party.fctr.Low.cor.X..rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.glmnet
## 1                                0.2625272                            R
## 2                                0.3704867                            D
## 3                                0.4398807                            R
## 4                                0.2510396                            R
##   Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 1                         0.8068305                                TRUE
## 2                         0.3386699                                TRUE
## 3                         0.5785178                                TRUE
## 4                         0.8068305                                TRUE
##   Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 1                            FALSE                            0.1931695
## 2                            FALSE                            0.3386699
## 3                            FALSE                            0.4214822
## 4                            FALSE                            0.1931695
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 1                                          R
## 2                                          D
## 3                                          D
## 4                                          R
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 1                                       0.5528980
## 2                                       0.3718278
## 3                                       0.4173116
## 4                                       0.5667831
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 1                                              TRUE
## 2                                              TRUE
## 3                                             FALSE
## 4                                              TRUE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 1                                          FALSE
## 2                                          FALSE
## 3                                           TRUE
## 4                                          FALSE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 1                                          0.4471020
## 2                                          0.3718278
## 3                                          0.5826884
## 4                                          0.4332169
##   Party.fctr.All.X.spatialSign.rcv.glmnet
## 1                                       R
## 2                                       D
## 3                                       R
## 4                                       R
##   Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 1                                    0.6235856
## 2                                    0.3967551
## 3                                    0.5263820
## 4                                    0.6728866
##   Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 1                                           TRUE
## 2                                           TRUE
## 3                                           TRUE
## 4                                           TRUE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 1                                       FALSE
## 2                                       FALSE
## 3                                       FALSE
## 4                                       FALSE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.3764144
## 2                                       0.3967551
## 3                                       0.4736180
## 4                                       0.3271134
##   Party.fctr.All.X..rcv.rpart Party.fctr.All.X..rcv.rpart.prob
## 1                           R                        0.6225490
## 2                           D                        0.2330827
## 3                           R                        0.6225490
## 4                           R                        0.6225490
##   Party.fctr.All.X..rcv.rpart.is.acc Party.fctr.All.X..rcv.rpart.err
## 1                               TRUE                           FALSE
## 2                               TRUE                           FALSE
## 3                               TRUE                           FALSE
## 4                               TRUE                           FALSE
##   Party.fctr.All.X..rcv.rpart.err.abs
## 1                           0.3774510
## 2                           0.2330827
## 3                           0.3774510
## 4                           0.3774510
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet
## 1                                     D
## 2                                     D
## 3                                     D
## 4                                     D
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## 1                                  0.5122987
## 2                                  0.3479286
## 3                                  0.4206517
## 4                                  0.5122987
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.is.acc
## 1                                        FALSE
## 2                                         TRUE
## 3                                        FALSE
## 4                                        FALSE
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err
## 1                                      TRUE
## 2                                     FALSE
## 3                                      TRUE
## 4                                      TRUE
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err.abs
## 1                                     0.4877013
## 2                                     0.3479286
## 3                                     0.5793483
## 4                                     0.4877013
##   Party.fctr.Max.cor.Y..rcv.rpart Party.fctr.Max.cor.Y..rcv.rpart.prob
## 1                               R                            0.5212650
## 2                               D                            0.3000000
## 3                               D                            0.4231928
## 4                               R                            0.5212650
##   Party.fctr.Max.cor.Y..rcv.rpart.is.acc
## 1                                   TRUE
## 2                                   TRUE
## 3                                  FALSE
## 4                                   TRUE
##   Party.fctr.Max.cor.Y..rcv.rpart.err
## 1                               FALSE
## 2                               FALSE
## 3                                TRUE
## 4                               FALSE
##   Party.fctr.Max.cor.Y..rcv.rpart.err.abs Party.fctr.All.X.ica.rcv.glmnet
## 1                               0.4787350                               D
## 2                               0.3000000                               D
## 3                               0.5768072                               D
## 4                               0.4787350                               R
##   Party.fctr.All.X.ica.rcv.glmnet.prob
## 1                            0.4593517
## 2                            0.4457785
## 3                            0.4573875
## 4                            0.5018623
##   Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                   TRUE
## 3                                  FALSE
## 4                                   TRUE
##   Party.fctr.All.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                               FALSE
## 3                                TRUE
## 4                               FALSE
##   Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 1                               0.5406483
## 2                               0.4457785
## 3                               0.5426125
## 4                               0.4981377
##   Party.fctr.All.X.zv.pca.rcv.glmnet.accurate
## 1                                        TRUE
## 2                                        TRUE
## 3                                        TRUE
## 4                                        TRUE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.error .label
## 1                                        0   1930
## 2                                        0   2193
## 3                                        0   4842
## 4                                        0   6364
## [1] "Inaccurate: "
##   USER_ID Party.fctr Party.fctr.All.X.zv.pca.rcv.glmnet
## 1    1264          R                                  D
## 2    2425          R                                  D
## 3    2598          R                                  D
## 4    1792          R                                  D
## 5    3075          R                                  D
## 6    5135          R                                  D
##   Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 1                              0.03778821
## 2                              0.18290336
## 3                              0.19627590
## 4                              0.20704953
## 5                              0.21508124
## 6                              0.23118250
##   Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs
## 1                                  0.9622118
## 2                                  0.8170966
## 3                                  0.8037241
## 4                                  0.7929505
## 5                                  0.7849188
## 6                                  0.7688175
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet
## 1                                             D
## 2                                             D
## 3                                             D
## 4                                             D
## 5                                             D
## 6                                             D
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## 1                                          0.2243570
## 2                                          0.3291627
## 3                                          0.3659195
## 4                                          0.3926747
## 5                                          0.4268439
## 6                                          0.4034658
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.is.acc
## 1                                                FALSE
## 2                                                FALSE
## 3                                                FALSE
## 4                                                FALSE
## 5                                                FALSE
## 6                                                FALSE
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err
## 1                                              TRUE
## 2                                              TRUE
## 3                                              TRUE
## 4                                              TRUE
## 5                                              TRUE
## 6                                              TRUE
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err.abs
## 1                                             0.7756430
## 2                                             0.6708373
## 3                                             0.6340805
## 4                                             0.6073253
## 5                                             0.5731561
## 6                                             0.5965342
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      D
## 3                                      D
## 4                                      D
## 5                                      R
## 6                                      D
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 1                                   0.2109323
## 2                                   0.4178371
## 3                                   0.2606008
## 4                                   0.2949764
## 5                                   0.4559329
## 6                                   0.3159621
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                         FALSE
## 3                                         FALSE
## 4                                         FALSE
## 5                                          TRUE
## 6                                         FALSE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                       TRUE
## 3                                       TRUE
## 4                                       TRUE
## 5                                      FALSE
## 6                                       TRUE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.7890677
## 2                                      0.5821629
## 3                                      0.7393992
## 4                                      0.7050236
## 5                                      0.5440671
## 6                                      0.6840379
##   Party.fctr.All.X.expoTrans.rcv.glmnet
## 1                                     D
## 2                                     D
## 3                                     D
## 4                                     D
## 5                                     R
## 6                                     D
##   Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 1                                  0.2109067
## 2                                  0.4176702
## 3                                  0.2605618
## 4                                  0.2950351
## 5                                  0.4559066
## 6                                  0.3159338
##   Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
## 5                                         TRUE
## 6                                        FALSE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
## 5                                     FALSE
## 6                                      TRUE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.7890933
## 2                                     0.5823298
## 3                                     0.7394382
## 4                                     0.7049649
## 5                                     0.5440934
## 6                                     0.6840662
##   Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 1                            D                         0.2112086
## 2                            D                         0.4171643
## 3                            D                         0.2612503
## 4                            D                         0.2946746
## 5                            R                         0.4565205
## 6                            D                         0.3160730
##   Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 1                               FALSE                             TRUE
## 2                               FALSE                             TRUE
## 3                               FALSE                             TRUE
## 4                               FALSE                             TRUE
## 5                                TRUE                            FALSE
## 6                               FALSE                             TRUE
##   Party.fctr.All.X..rcv.glmnet.err.abs
## 1                            0.7887914
## 2                            0.5828357
## 3                            0.7387497
## 4                            0.7053254
## 5                            0.5434795
## 6                            0.6839270
##   Party.fctr.All.X.conditionalX.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        R
## 6                                        D
##   Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 1                                     0.2112086
## 2                                     0.4171643
## 3                                     0.2612503
## 4                                     0.2946746
## 5                                     0.4565205
## 6                                     0.3160730
##   Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                            TRUE
## 6                                           FALSE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                        FALSE
## 6                                         TRUE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.7887914
## 2                                        0.5828357
## 3                                        0.7387497
## 4                                        0.7053254
## 5                                        0.5434795
## 6                                        0.6839270
##   Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 1                              D                           0.2112086
## 2                              D                           0.4171643
## 3                              D                           0.2612503
## 4                              D                           0.2946746
## 5                              R                           0.4565205
## 6                              D                           0.3160730
##   Party.fctr.All.X.zv.rcv.glmnet.is.acc Party.fctr.All.X.zv.rcv.glmnet.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                  TRUE                              FALSE
## 6                                 FALSE                               TRUE
##   Party.fctr.All.X.zv.rcv.glmnet.err.abs
## 1                              0.7887914
## 2                              0.5828357
## 3                              0.7387497
## 4                              0.7053254
## 5                              0.5434795
## 6                              0.6839270
##   Party.fctr.All.X.center.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  R
## 6                                  D
##   Party.fctr.All.X.center.rcv.glmnet.prob
## 1                               0.2112086
## 2                               0.4171643
## 3                               0.2612503
## 4                               0.2946746
## 5                               0.4565205
## 6                               0.3160730
##   Party.fctr.All.X.center.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                      TRUE
## 6                                     FALSE
##   Party.fctr.All.X.center.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                  FALSE
## 6                                   TRUE
##   Party.fctr.All.X.center.rcv.glmnet.err.abs
## 1                                  0.7887914
## 2                                  0.5828357
## 3                                  0.7387497
## 4                                  0.7053254
## 5                                  0.5434795
## 6                                  0.6839270
##   Party.fctr.All.X.scale.rcv.glmnet Party.fctr.All.X.scale.rcv.glmnet.prob
## 1                                 D                              0.2112086
## 2                                 D                              0.4171643
## 3                                 D                              0.2612503
## 4                                 D                              0.2946746
## 5                                 R                              0.4565205
## 6                                 D                              0.3160730
##   Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                     TRUE
## 6                                    FALSE
##   Party.fctr.All.X.scale.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                 FALSE
## 6                                  TRUE
##   Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 1                                 0.7887914
## 2                                 0.5828357
## 3                                 0.7387497
## 4                                 0.7053254
## 5                                 0.5434795
## 6                                 0.6839270
##   Party.fctr.All.X.center.scale.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        R
## 6                                        D
##   Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 1                                     0.2112086
## 2                                     0.4171643
## 3                                     0.2612503
## 4                                     0.2946746
## 5                                     0.4565205
## 6                                     0.3160730
##   Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                            TRUE
## 6                                           FALSE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                        FALSE
## 6                                         TRUE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.7887914
## 2                                        0.5828357
## 3                                        0.7387497
## 4                                        0.7053254
## 5                                        0.5434795
## 6                                        0.6839270
##   Party.fctr.All.X.BoxCox.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  R
## 6                                  D
##   Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 1                               0.2112086
## 2                               0.4171643
## 3                               0.2612503
## 4                               0.2946746
## 5                               0.4565205
## 6                               0.3160730
##   Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                      TRUE
## 6                                     FALSE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                  FALSE
## 6                                   TRUE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.7887914
## 2                                  0.5828357
## 3                                  0.7387497
## 4                                  0.7053254
## 5                                  0.5434795
## 6                                  0.6839270
##   Party.fctr.All.X.range.rcv.glmnet Party.fctr.All.X.range.rcv.glmnet.prob
## 1                                 D                              0.2112086
## 2                                 D                              0.4171643
## 3                                 D                              0.2612503
## 4                                 D                              0.2946746
## 5                                 R                              0.4565205
## 6                                 D                              0.3160730
##   Party.fctr.All.X.range.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                     TRUE
## 6                                    FALSE
##   Party.fctr.All.X.range.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                 FALSE
## 6                                  TRUE
##   Party.fctr.All.X.range.rcv.glmnet.err.abs Party.fctr.All.X..rcv.gbm
## 1                                 0.7887914                         D
## 2                                 0.5828357                         D
## 3                                 0.7387497                         D
## 4                                 0.7053254                         D
## 5                                 0.5434795                         D
## 6                                 0.6839270                         D
##   Party.fctr.All.X..rcv.gbm.prob Party.fctr.All.X..rcv.gbm.is.acc
## 1                     0.08076739                            FALSE
## 2                     0.45532679                            FALSE
## 3                     0.20898001                            FALSE
## 4                     0.13013300                            FALSE
## 5                     0.26090271                            FALSE
## 6                     0.22351355                            FALSE
##   Party.fctr.All.X..rcv.gbm.err Party.fctr.All.X..rcv.gbm.err.abs
## 1                          TRUE                         0.9192326
## 2                          TRUE                         0.5446732
## 3                          TRUE                         0.7910200
## 4                          TRUE                         0.8698670
## 5                          TRUE                         0.7390973
## 6                          TRUE                         0.7764865
##   Party.fctr.All.X..rcv.nnet Party.fctr.All.X..rcv.nnet.prob
## 1                          D                       0.1444532
## 2                          D                       0.1444532
## 3                          D                       0.1444579
## 4                          D                       0.1444532
## 5                          D                       0.1444532
## 6                          D                       0.1444532
##   Party.fctr.All.X..rcv.nnet.is.acc Party.fctr.All.X..rcv.nnet.err
## 1                             FALSE                           TRUE
## 2                             FALSE                           TRUE
## 3                             FALSE                           TRUE
## 4                             FALSE                           TRUE
## 5                             FALSE                           TRUE
## 6                             FALSE                           TRUE
##   Party.fctr.All.X..rcv.nnet.err.abs Party.fctr.All.X..rcv.earth
## 1                          0.8555468                           D
## 2                          0.8555468                           D
## 3                          0.8555421                           D
## 4                          0.8555468                           D
## 5                          0.8555468                           R
## 6                          0.8555468                           D
##   Party.fctr.All.X..rcv.earth.prob Party.fctr.All.X..rcv.earth.is.acc
## 1                       0.04308791                              FALSE
## 2                       0.45344312                              FALSE
## 3                       0.22104390                              FALSE
## 4                       0.13143985                              FALSE
## 5                       0.56145625                               TRUE
## 6                       0.22175165                              FALSE
##   Party.fctr.All.X..rcv.earth.err Party.fctr.All.X..rcv.earth.err.abs
## 1                            TRUE                           0.9569121
## 2                            TRUE                           0.5465569
## 3                            TRUE                           0.7789561
## 4                            TRUE                           0.8685602
## 5                           FALSE                           0.4385437
## 6                            TRUE                           0.7782484
##   Party.fctr.All.X..rcv.bayesglm Party.fctr.All.X..rcv.bayesglm.prob
## 1                              D                          0.00161350
## 2                              R                          0.48751943
## 3                              D                          0.08387007
## 4                              D                          0.07457130
## 5                              D                          0.19165646
## 6                              D                          0.12043034
##   Party.fctr.All.X..rcv.bayesglm.is.acc Party.fctr.All.X..rcv.bayesglm.err
## 1                                 FALSE                               TRUE
## 2                                  TRUE                              FALSE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.All.X..rcv.bayesglm.err.abs Party.fctr.All.X..rcv.glm
## 1                              0.9983865                         D
## 2                              0.5124806                         R
## 3                              0.9161299                         D
## 4                              0.9254287                         D
## 5                              0.8083435                         D
## 6                              0.8795697                         D
##   Party.fctr.All.X..rcv.glm.prob Party.fctr.All.X..rcv.glm.is.acc
## 1                    0.001271532                            FALSE
## 2                    0.510067143                             TRUE
## 3                    0.080450646                            FALSE
## 4                    0.067093075                            FALSE
## 5                    0.205301849                            FALSE
## 6                    0.120823990                            FALSE
##   Party.fctr.All.X..rcv.glm.err Party.fctr.All.X..rcv.glm.err.abs
## 1                          TRUE                         0.9987285
## 2                         FALSE                         0.4899329
## 3                          TRUE                         0.9195494
## 4                          TRUE                         0.9329069
## 5                          TRUE                         0.7946982
## 6                          TRUE                         0.8791760
##   Party.fctr.All.X..rcv.bagEarth Party.fctr.All.X..rcv.bagEarth.prob
## 1                              D                          0.02797337
## 2                              D                          0.34227459
## 3                              D                          0.14521021
## 4                              D                          0.15365525
## 5                              D                          0.35316477
## 6                              D                          0.14529882
##   Party.fctr.All.X..rcv.bagEarth.is.acc Party.fctr.All.X..rcv.bagEarth.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.All.X..rcv.bagEarth.err.abs Party.fctr.All.X.nzv.rcv.glmnet
## 1                              0.9720266                               D
## 2                              0.6577254                               D
## 3                              0.8547898                               D
## 4                              0.8463447                               D
## 5                              0.6468352                               D
## 6                              0.8547012                               D
##   Party.fctr.All.X.nzv.rcv.glmnet.prob
## 1                            0.2244944
## 2                            0.4155892
## 3                            0.2553022
## 4                            0.3173852
## 5                            0.4496689
## 6                            0.3088578
##   Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.All.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.All.X..rcv.rf
## 1                               0.7755056                        D
## 2                               0.5844108                        D
## 3                               0.7446978                        D
## 4                               0.6826148                        D
## 5                               0.5503311                        D
## 6                               0.6911422                        D
##   Party.fctr.All.X..rcv.rf.prob Party.fctr.All.X..rcv.rf.is.acc
## 1                         0.336                           FALSE
## 2                         0.462                           FALSE
## 3                         0.266                           FALSE
## 4                         0.350                           FALSE
## 5                         0.516                           FALSE
## 6                         0.356                           FALSE
##   Party.fctr.All.X..rcv.rf.err Party.fctr.All.X..rcv.rf.err.abs
## 1                         TRUE                            0.664
## 2                         TRUE                            0.538
## 3                         TRUE                            0.734
## 4                         TRUE                            0.650
## 5                         TRUE                            0.484
## 6                         TRUE                            0.644
##   Party.fctr.All.X..rcv.avNNet Party.fctr.All.X..rcv.avNNet.prob
## 1                            D                        0.08222648
## 2                            D                        0.38341447
## 3                            D                        0.16135415
## 4                            D                        0.35362190
## 5                            R                        0.57005964
## 6                            D                        0.04079462
##   Party.fctr.All.X..rcv.avNNet.is.acc Party.fctr.All.X..rcv.avNNet.err
## 1                               FALSE                             TRUE
## 2                               FALSE                             TRUE
## 3                               FALSE                             TRUE
## 4                               FALSE                             TRUE
## 5                                TRUE                            FALSE
## 6                               FALSE                             TRUE
##   Party.fctr.All.X..rcv.avNNet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 1                            0.9177735                                D
## 2                            0.6165855                                D
## 3                            0.8386458                                D
## 4                            0.6463781                                D
## 5                            0.4299404                                R
## 6                            0.9592054                                D
##   Party.fctr.Low.cor.X..rcv.glmnet.prob
## 1                             0.2260633
## 2                             0.4104362
## 3                             0.2636520
## 4                             0.2988611
## 5                             0.4599529
## 6                             0.3419146
##   Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 1                                   FALSE
## 2                                   FALSE
## 3                                   FALSE
## 4                                   FALSE
## 5                                    TRUE
## 6                                   FALSE
##   Party.fctr.Low.cor.X..rcv.glmnet.err
## 1                                 TRUE
## 2                                 TRUE
## 3                                 TRUE
## 4                                 TRUE
## 5                                FALSE
## 6                                 TRUE
##   Party.fctr.Low.cor.X..rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.glmnet
## 1                                0.7739367                            D
## 2                                0.5895638                            R
## 3                                0.7363480                            D
## 4                                0.7011389                            D
## 5                                0.5400471                            R
## 6                                0.6580854                            D
##   Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 1                         0.2761808                               FALSE
## 2                         0.4678495                                TRUE
## 3                         0.1919553                               FALSE
## 4                         0.2989232                               FALSE
## 5                         0.4616245                                TRUE
## 6                         0.2686179                               FALSE
##   Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 1                             TRUE                            0.7238192
## 2                            FALSE                            0.5321505
## 3                             TRUE                            0.8080447
## 4                             TRUE                            0.7010768
## 5                            FALSE                            0.5383755
## 6                             TRUE                            0.7313821
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 1                                          D
## 2                                          R
## 3                                          D
## 4                                          D
## 5                                          D
## 6                                          D
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 1                                       0.1562647
## 2                                       0.5101452
## 3                                       0.2926265
## 4                                       0.4683587
## 5                                       0.4007987
## 6                                       0.2650570
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 1                                             FALSE
## 2                                              TRUE
## 3                                             FALSE
## 4                                             FALSE
## 5                                             FALSE
## 6                                             FALSE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 1                                           TRUE
## 2                                          FALSE
## 3                                           TRUE
## 4                                           TRUE
## 5                                           TRUE
## 6                                           TRUE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 1                                          0.8437353
## 2                                          0.4898548
## 3                                          0.7073735
## 4                                          0.5316413
## 5                                          0.5992013
## 6                                          0.7349430
##   Party.fctr.All.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
## 3                                       D
## 4                                       D
## 5                                       D
## 6                                       D
##   Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 1                                    0.3087263
## 2                                    0.4362794
## 3                                    0.3005692
## 4                                    0.4164756
## 5                                    0.4436372
## 6                                    0.3642021
##   Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                          FALSE
## 3                                          FALSE
## 4                                          FALSE
## 5                                          FALSE
## 6                                          FALSE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                        TRUE
## 3                                        TRUE
## 4                                        TRUE
## 5                                        TRUE
## 6                                        TRUE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.6912737
## 2                                       0.5637206
## 3                                       0.6994308
## 4                                       0.5835244
## 5                                       0.5563628
## 6                                       0.6357979
##   Party.fctr.All.X..rcv.rpart Party.fctr.All.X..rcv.rpart.prob
## 1                           D                        0.2330827
## 2                           D                        0.5385802
## 3                           D                        0.2330827
## 4                           D                        0.3412322
## 5                           R                        0.6225490
## 6                           D                        0.3412322
##   Party.fctr.All.X..rcv.rpart.is.acc Party.fctr.All.X..rcv.rpart.err
## 1                              FALSE                            TRUE
## 2                              FALSE                            TRUE
## 3                              FALSE                            TRUE
## 4                              FALSE                            TRUE
## 5                               TRUE                           FALSE
## 6                              FALSE                            TRUE
##   Party.fctr.All.X..rcv.rpart.err.abs
## 1                           0.7669173
## 2                           0.4614198
## 3                           0.7669173
## 4                           0.6587678
## 5                           0.3774510
## 6                           0.6587678
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet
## 1                                     D
## 2                                     R
## 3                                     D
## 4                                     R
## 5                                     D
## 6                                     D
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## 1                                  0.2694411
## 2                                  0.5531271
## 3                                  0.2694411
## 4                                  0.5531271
## 5                                  0.4206517
## 6                                  0.4206517
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.is.acc
## 1                                        FALSE
## 2                                         TRUE
## 3                                        FALSE
## 4                                         TRUE
## 5                                        FALSE
## 6                                        FALSE
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err
## 1                                      TRUE
## 2                                     FALSE
## 3                                      TRUE
## 4                                     FALSE
## 5                                      TRUE
## 6                                      TRUE
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err.abs
## 1                                     0.7305589
## 2                                     0.4468729
## 3                                     0.7305589
## 4                                     0.4468729
## 5                                     0.5793483
## 6                                     0.5793483
##   Party.fctr.Max.cor.Y..rcv.rpart Party.fctr.Max.cor.Y..rcv.rpart.prob
## 1                               D                            0.3000000
## 2                               R                            0.5212650
## 3                               D                            0.3000000
## 4                               R                            0.5212650
## 5                               D                            0.4231928
## 6                               D                            0.4231928
##   Party.fctr.Max.cor.Y..rcv.rpart.is.acc
## 1                                  FALSE
## 2                                   TRUE
## 3                                  FALSE
## 4                                   TRUE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.Max.cor.Y..rcv.rpart.err
## 1                                TRUE
## 2                               FALSE
## 3                                TRUE
## 4                               FALSE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.Max.cor.Y..rcv.rpart.err.abs Party.fctr.All.X.ica.rcv.glmnet
## 1                               0.7000000                               D
## 2                               0.4787350                               D
## 3                               0.7000000                               D
## 4                               0.4787350                               D
## 5                               0.5768072                               D
## 6                               0.5768072                               D
##   Party.fctr.All.X.ica.rcv.glmnet.prob
## 1                            0.4533077
## 2                            0.4303934
## 3                            0.4442853
## 4                            0.4378072
## 5                            0.4448455
## 6                            0.4462038
##   Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.All.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 1                               0.5466923
## 2                               0.5696066
## 3                               0.5557147
## 4                               0.5621928
## 5                               0.5551545
## 6                               0.5537962
##   Party.fctr.All.X.zv.pca.rcv.glmnet.accurate
## 1                                       FALSE
## 2                                       FALSE
## 3                                       FALSE
## 4                                       FALSE
## 5                                       FALSE
## 6                                       FALSE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.error
## 1                               -0.4122118
## 2                               -0.2670966
## 3                               -0.2537241
## 4                               -0.2429505
## 5                               -0.2349188
## 6                               -0.2188175
##     USER_ID Party.fctr Party.fctr.All.X.zv.pca.rcv.glmnet
## 7      6088          R                                  D
## 9      2851          R                                  D
## 84     2975          D                                  R
## 94     6624          D                                  R
## 104    6878          D                                  R
## 108     789          D                                  R
##     Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 7                                 0.2396066
## 9                                 0.2426496
## 84                                0.5001730
## 94                                0.5177620
## 104                               0.5378576
## 108                               0.5470562
##     Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 7                                       FALSE
## 9                                       FALSE
## 84                                      FALSE
## 94                                      FALSE
## 104                                     FALSE
## 108                                     FALSE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 7                                     TRUE
## 9                                     TRUE
## 84                                    TRUE
## 94                                    TRUE
## 104                                   TRUE
## 108                                   TRUE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs
## 7                                    0.7603934
## 9                                    0.7573504
## 84                                   0.5001730
## 94                                   0.5177620
## 104                                  0.5378576
## 108                                  0.5470562
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet
## 7                                               D
## 9                                               D
## 84                                              R
## 94                                              R
## 104                                             R
## 108                                             R
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## 7                                            0.3541386
## 9                                            0.4423358
## 84                                           0.4566774
## 94                                           0.5033842
## 104                                          0.4944699
## 108                                          0.5093538
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.is.acc
## 7                                                  FALSE
## 9                                                  FALSE
## 84                                                 FALSE
## 94                                                 FALSE
## 104                                                FALSE
## 108                                                FALSE
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err
## 7                                                TRUE
## 9                                                TRUE
## 84                                               TRUE
## 94                                               TRUE
## 104                                              TRUE
## 108                                              TRUE
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err.abs
## 7                                               0.6458614
## 9                                               0.5576642
## 84                                              0.4566774
## 94                                              0.5033842
## 104                                             0.4944699
## 108                                             0.5093538
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 7                                        D
## 9                                        R
## 84                                       R
## 94                                       R
## 104                                      R
## 108                                      R
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 7                                     0.3912631
## 9                                     0.4677722
## 84                                    0.5591893
## 94                                    0.4821667
## 104                                   0.4711635
## 108                                   0.5440807
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 7                                           FALSE
## 9                                            TRUE
## 84                                          FALSE
## 94                                          FALSE
## 104                                         FALSE
## 108                                         FALSE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 7                                         TRUE
## 9                                        FALSE
## 84                                        TRUE
## 94                                        TRUE
## 104                                       TRUE
## 108                                       TRUE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 7                                        0.6087369
## 9                                        0.5322278
## 84                                       0.5591893
## 94                                       0.4821667
## 104                                      0.4711635
## 108                                      0.5440807
##     Party.fctr.All.X.expoTrans.rcv.glmnet
## 7                                       D
## 9                                       R
## 84                                      R
## 94                                      R
## 104                                     R
## 108                                     R
##     Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 7                                    0.3912911
## 9                                    0.4677691
## 84                                   0.5593019
## 94                                   0.4820232
## 104                                  0.4710480
## 108                                  0.5440089
##     Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 7                                          FALSE
## 9                                           TRUE
## 84                                         FALSE
## 94                                         FALSE
## 104                                        FALSE
## 108                                        FALSE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 7                                        TRUE
## 9                                       FALSE
## 84                                       TRUE
## 94                                       TRUE
## 104                                      TRUE
## 108                                      TRUE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 7                                       0.6087089
## 9                                       0.5322309
## 84                                      0.5593019
## 94                                      0.4820232
## 104                                     0.4710480
## 108                                     0.5440089
##     Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 7                              D                         0.3903466
## 9                              R                         0.4679288
## 84                             R                         0.5590236
## 94                             R                         0.4827557
## 104                            R                         0.4709386
## 108                            R                         0.5444500
##     Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 7                                 FALSE                             TRUE
## 9                                  TRUE                            FALSE
## 84                                FALSE                             TRUE
## 94                                FALSE                             TRUE
## 104                               FALSE                             TRUE
## 108                               FALSE                             TRUE
##     Party.fctr.All.X..rcv.glmnet.err.abs
## 7                              0.6096534
## 9                              0.5320712
## 84                             0.5590236
## 94                             0.4827557
## 104                            0.4709386
## 108                            0.5444500
##     Party.fctr.All.X.conditionalX.rcv.glmnet
## 7                                          D
## 9                                          R
## 84                                         R
## 94                                         R
## 104                                        R
## 108                                        R
##     Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 7                                       0.3903466
## 9                                       0.4679288
## 84                                      0.5590236
## 94                                      0.4827557
## 104                                     0.4709386
## 108                                     0.5444500
##     Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 7                                             FALSE
## 9                                              TRUE
## 84                                            FALSE
## 94                                            FALSE
## 104                                           FALSE
## 108                                           FALSE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 7                                           TRUE
## 9                                          FALSE
## 84                                          TRUE
## 94                                          TRUE
## 104                                         TRUE
## 108                                         TRUE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 7                                          0.6096534
## 9                                          0.5320712
## 84                                         0.5590236
## 94                                         0.4827557
## 104                                        0.4709386
## 108                                        0.5444500
##     Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 7                                D                           0.3903466
## 9                                R                           0.4679288
## 84                               R                           0.5590236
## 94                               R                           0.4827557
## 104                              R                           0.4709386
## 108                              R                           0.5444500
##     Party.fctr.All.X.zv.rcv.glmnet.is.acc
## 7                                   FALSE
## 9                                    TRUE
## 84                                  FALSE
## 94                                  FALSE
## 104                                 FALSE
## 108                                 FALSE
##     Party.fctr.All.X.zv.rcv.glmnet.err
## 7                                 TRUE
## 9                                FALSE
## 84                                TRUE
## 94                                TRUE
## 104                               TRUE
## 108                               TRUE
##     Party.fctr.All.X.zv.rcv.glmnet.err.abs
## 7                                0.6096534
## 9                                0.5320712
## 84                               0.5590236
## 94                               0.4827557
## 104                              0.4709386
## 108                              0.5444500
##     Party.fctr.All.X.center.rcv.glmnet
## 7                                    D
## 9                                    R
## 84                                   R
## 94                                   R
## 104                                  R
## 108                                  R
##     Party.fctr.All.X.center.rcv.glmnet.prob
## 7                                 0.3903466
## 9                                 0.4679288
## 84                                0.5590236
## 94                                0.4827557
## 104                               0.4709386
## 108                               0.5444500
##     Party.fctr.All.X.center.rcv.glmnet.is.acc
## 7                                       FALSE
## 9                                        TRUE
## 84                                      FALSE
## 94                                      FALSE
## 104                                     FALSE
## 108                                     FALSE
##     Party.fctr.All.X.center.rcv.glmnet.err
## 7                                     TRUE
## 9                                    FALSE
## 84                                    TRUE
## 94                                    TRUE
## 104                                   TRUE
## 108                                   TRUE
##     Party.fctr.All.X.center.rcv.glmnet.err.abs
## 7                                    0.6096534
## 9                                    0.5320712
## 84                                   0.5590236
## 94                                   0.4827557
## 104                                  0.4709386
## 108                                  0.5444500
##     Party.fctr.All.X.scale.rcv.glmnet
## 7                                   D
## 9                                   R
## 84                                  R
## 94                                  R
## 104                                 R
## 108                                 R
##     Party.fctr.All.X.scale.rcv.glmnet.prob
## 7                                0.3903466
## 9                                0.4679288
## 84                               0.5590236
## 94                               0.4827557
## 104                              0.4709386
## 108                              0.5444500
##     Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 7                                      FALSE
## 9                                       TRUE
## 84                                     FALSE
## 94                                     FALSE
## 104                                    FALSE
## 108                                    FALSE
##     Party.fctr.All.X.scale.rcv.glmnet.err
## 7                                    TRUE
## 9                                   FALSE
## 84                                   TRUE
## 94                                   TRUE
## 104                                  TRUE
## 108                                  TRUE
##     Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 7                                   0.6096534
## 9                                   0.5320712
## 84                                  0.5590236
## 94                                  0.4827557
## 104                                 0.4709386
## 108                                 0.5444500
##     Party.fctr.All.X.center.scale.rcv.glmnet
## 7                                          D
## 9                                          R
## 84                                         R
## 94                                         R
## 104                                        R
## 108                                        R
##     Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 7                                       0.3903466
## 9                                       0.4679288
## 84                                      0.5590236
## 94                                      0.4827557
## 104                                     0.4709386
## 108                                     0.5444500
##     Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 7                                             FALSE
## 9                                              TRUE
## 84                                            FALSE
## 94                                            FALSE
## 104                                           FALSE
## 108                                           FALSE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err
## 7                                           TRUE
## 9                                          FALSE
## 84                                          TRUE
## 94                                          TRUE
## 104                                         TRUE
## 108                                         TRUE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 7                                          0.6096534
## 9                                          0.5320712
## 84                                         0.5590236
## 94                                         0.4827557
## 104                                        0.4709386
## 108                                        0.5444500
##     Party.fctr.All.X.BoxCox.rcv.glmnet
## 7                                    D
## 9                                    R
## 84                                   R
## 94                                   R
## 104                                  R
## 108                                  R
##     Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 7                                 0.3903466
## 9                                 0.4679288
## 84                                0.5590236
## 94                                0.4827557
## 104                               0.4709386
## 108                               0.5444500
##     Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 7                                       FALSE
## 9                                        TRUE
## 84                                      FALSE
## 94                                      FALSE
## 104                                     FALSE
## 108                                     FALSE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 7                                     TRUE
## 9                                    FALSE
## 84                                    TRUE
## 94                                    TRUE
## 104                                   TRUE
## 108                                   TRUE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 7                                    0.6096534
## 9                                    0.5320712
## 84                                   0.5590236
## 94                                   0.4827557
## 104                                  0.4709386
## 108                                  0.5444500
##     Party.fctr.All.X.range.rcv.glmnet
## 7                                   D
## 9                                   R
## 84                                  R
## 94                                  R
## 104                                 R
## 108                                 R
##     Party.fctr.All.X.range.rcv.glmnet.prob
## 7                                0.3903466
## 9                                0.4679288
## 84                               0.5590236
## 94                               0.4827557
## 104                              0.4709386
## 108                              0.5444500
##     Party.fctr.All.X.range.rcv.glmnet.is.acc
## 7                                      FALSE
## 9                                       TRUE
## 84                                     FALSE
## 94                                     FALSE
## 104                                    FALSE
## 108                                    FALSE
##     Party.fctr.All.X.range.rcv.glmnet.err
## 7                                    TRUE
## 9                                   FALSE
## 84                                   TRUE
## 94                                   TRUE
## 104                                  TRUE
## 108                                  TRUE
##     Party.fctr.All.X.range.rcv.glmnet.err.abs Party.fctr.All.X..rcv.gbm
## 7                                   0.6096534                         D
## 9                                   0.5320712                         D
## 84                                  0.5590236                         R
## 94                                  0.4827557                         D
## 104                                 0.4709386                         D
## 108                                 0.5444500                         R
##     Party.fctr.All.X..rcv.gbm.prob Party.fctr.All.X..rcv.gbm.is.acc
## 7                        0.2512227                            FALSE
## 9                        0.3069208                            FALSE
## 84                       0.6807916                            FALSE
## 94                       0.4931859                             TRUE
## 104                      0.3578731                             TRUE
## 108                      0.6327232                            FALSE
##     Party.fctr.All.X..rcv.gbm.err Party.fctr.All.X..rcv.gbm.err.abs
## 7                            TRUE                         0.7487773
## 9                            TRUE                         0.6930792
## 84                           TRUE                         0.6807916
## 94                          FALSE                         0.4931859
## 104                         FALSE                         0.3578731
## 108                          TRUE                         0.6327232
##     Party.fctr.All.X..rcv.nnet Party.fctr.All.X..rcv.nnet.prob
## 7                            D                       0.1444532
## 9                            D                       0.1444570
## 84                           R                       0.7833399
## 94                           R                       0.3907186
## 104                          D                       0.1444542
## 108                          R                       0.7767761
##     Party.fctr.All.X..rcv.nnet.is.acc Party.fctr.All.X..rcv.nnet.err
## 7                               FALSE                           TRUE
## 9                               FALSE                           TRUE
## 84                              FALSE                           TRUE
## 94                              FALSE                           TRUE
## 104                              TRUE                          FALSE
## 108                             FALSE                           TRUE
##     Party.fctr.All.X..rcv.nnet.err.abs Party.fctr.All.X..rcv.earth
## 7                            0.8555468                           D
## 9                            0.8555430                           D
## 84                           0.7833399                           R
## 94                           0.3907186                           D
## 104                          0.1444542                           D
## 108                          0.7767761                           R
##     Party.fctr.All.X..rcv.earth.prob Party.fctr.All.X..rcv.earth.is.acc
## 7                          0.3897671                              FALSE
## 9                          0.4497795                              FALSE
## 84                         0.5719743                              FALSE
## 94                         0.3601893                               TRUE
## 104                        0.4940065                               TRUE
## 108                        0.6736216                              FALSE
##     Party.fctr.All.X..rcv.earth.err Party.fctr.All.X..rcv.earth.err.abs
## 7                              TRUE                           0.6102329
## 9                              TRUE                           0.5502205
## 84                             TRUE                           0.5719743
## 94                            FALSE                           0.3601893
## 104                           FALSE                           0.4940065
## 108                            TRUE                           0.6736216
##     Party.fctr.All.X..rcv.bayesglm Party.fctr.All.X..rcv.bayesglm.prob
## 7                                D                           0.2212168
## 9                                D                           0.2792836
## 84                               R                           0.6387576
## 94                               R                           0.4625413
## 104                              R                           0.5249263
## 108                              R                           0.7622141
##     Party.fctr.All.X..rcv.bayesglm.is.acc
## 7                                   FALSE
## 9                                   FALSE
## 84                                  FALSE
## 94                                  FALSE
## 104                                 FALSE
## 108                                 FALSE
##     Party.fctr.All.X..rcv.bayesglm.err
## 7                                 TRUE
## 9                                 TRUE
## 84                                TRUE
## 94                                TRUE
## 104                               TRUE
## 108                               TRUE
##     Party.fctr.All.X..rcv.bayesglm.err.abs Party.fctr.All.X..rcv.glm
## 7                                0.7787832                         D
## 9                                0.7207164                         D
## 84                               0.6387576                         R
## 94                               0.4625413                         R
## 104                              0.5249263                         R
## 108                              0.7622141                         R
##     Party.fctr.All.X..rcv.glm.prob Party.fctr.All.X..rcv.glm.is.acc
## 7                        0.2268058                            FALSE
## 9                        0.2739011                            FALSE
## 84                       0.6431251                            FALSE
## 94                       0.4600054                            FALSE
## 104                      0.5144306                            FALSE
## 108                      0.7708140                            FALSE
##     Party.fctr.All.X..rcv.glm.err Party.fctr.All.X..rcv.glm.err.abs
## 7                            TRUE                         0.7731942
## 9                            TRUE                         0.7260989
## 84                           TRUE                         0.6431251
## 94                           TRUE                         0.4600054
## 104                          TRUE                         0.5144306
## 108                          TRUE                         0.7708140
##     Party.fctr.All.X..rcv.bagEarth Party.fctr.All.X..rcv.bagEarth.prob
## 7                                D                           0.2829093
## 9                                D                           0.3282717
## 84                               R                           0.6052714
## 94                               D                           0.4361158
## 104                              R                           0.5782223
## 108                              R                           0.7378788
##     Party.fctr.All.X..rcv.bagEarth.is.acc
## 7                                   FALSE
## 9                                   FALSE
## 84                                  FALSE
## 94                                   TRUE
## 104                                 FALSE
## 108                                 FALSE
##     Party.fctr.All.X..rcv.bagEarth.err
## 7                                 TRUE
## 9                                 TRUE
## 84                                TRUE
## 94                               FALSE
## 104                               TRUE
## 108                               TRUE
##     Party.fctr.All.X..rcv.bagEarth.err.abs Party.fctr.All.X.nzv.rcv.glmnet
## 7                                0.7170907                               D
## 9                                0.6717283                               R
## 84                               0.6052714                               R
## 94                               0.4361158                               R
## 104                              0.5782223                               R
## 108                              0.7378788                               R
##     Party.fctr.All.X.nzv.rcv.glmnet.prob
## 7                              0.3886886
## 9                              0.4670527
## 84                             0.5585453
## 94                             0.4836537
## 104                            0.4702653
## 108                            0.5425073
##     Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 7                                    FALSE
## 9                                     TRUE
## 84                                   FALSE
## 94                                   FALSE
## 104                                  FALSE
## 108                                  FALSE
##     Party.fctr.All.X.nzv.rcv.glmnet.err
## 7                                  TRUE
## 9                                 FALSE
## 84                                 TRUE
## 94                                 TRUE
## 104                                TRUE
## 108                                TRUE
##     Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.All.X..rcv.rf
## 7                                 0.6113114                        D
## 9                                 0.5329473                        D
## 84                                0.5585453                        R
## 94                                0.4836537                        D
## 104                               0.4702653                        D
## 108                               0.5425073                        D
##     Party.fctr.All.X..rcv.rf.prob Party.fctr.All.X..rcv.rf.is.acc
## 7                           0.292                           FALSE
## 9                           0.412                           FALSE
## 84                          0.572                           FALSE
## 94                          0.516                            TRUE
## 104                         0.464                            TRUE
## 108                         0.524                            TRUE
##     Party.fctr.All.X..rcv.rf.err Party.fctr.All.X..rcv.rf.err.abs
## 7                           TRUE                            0.708
## 9                           TRUE                            0.588
## 84                          TRUE                            0.572
## 94                         FALSE                            0.516
## 104                        FALSE                            0.464
## 108                        FALSE                            0.524
##     Party.fctr.All.X..rcv.avNNet Party.fctr.All.X..rcv.avNNet.prob
## 7                              D                         0.2657753
## 9                              D                         0.5193802
## 84                             R                         0.7178254
## 94                             R                         0.5698570
## 104                            D                         0.4923467
## 108                            R                         0.8433885
##     Party.fctr.All.X..rcv.avNNet.is.acc Party.fctr.All.X..rcv.avNNet.err
## 7                                 FALSE                             TRUE
## 9                                 FALSE                             TRUE
## 84                                FALSE                             TRUE
## 94                                FALSE                             TRUE
## 104                                TRUE                            FALSE
## 108                               FALSE                             TRUE
##     Party.fctr.All.X..rcv.avNNet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 7                              0.7342247                                D
## 9                              0.4806198                                R
## 84                             0.7178254                                R
## 94                             0.5698570                                R
## 104                            0.4923467                                R
## 108                            0.8433885                                R
##     Party.fctr.Low.cor.X..rcv.glmnet.prob
## 7                               0.3946910
## 9                               0.4752584
## 84                              0.5575870
## 94                              0.4833976
## 104                             0.4701287
## 108                             0.5428923
##     Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 7                                     FALSE
## 9                                      TRUE
## 84                                    FALSE
## 94                                    FALSE
## 104                                   FALSE
## 108                                   FALSE
##     Party.fctr.Low.cor.X..rcv.glmnet.err
## 7                                   TRUE
## 9                                  FALSE
## 84                                  TRUE
## 94                                  TRUE
## 104                                 TRUE
## 108                                 TRUE
##     Party.fctr.Low.cor.X..rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.glmnet
## 7                                  0.6053090                            D
## 9                                  0.5247416                            R
## 84                                 0.5575870                            R
## 94                                 0.4833976                            R
## 104                                0.4701287                            R
## 108                                0.5428923                            R
##     Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 7                           0.3223156                               FALSE
## 9                           0.5182993                                TRUE
## 84                          0.6178362                               FALSE
## 94                          0.5262282                               FALSE
## 104                         0.4531176                               FALSE
## 108                         0.5458346                               FALSE
##     Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 7                               TRUE                            0.6776844
## 9                              FALSE                            0.4817007
## 84                              TRUE                            0.6178362
## 94                              TRUE                            0.5262282
## 104                             TRUE                            0.4531176
## 108                             TRUE                            0.5458346
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 7                                            D
## 9                                            D
## 84                                           D
## 94                                           R
## 104                                          R
## 108                                          D
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 7                                         0.4552124
## 9                                         0.4552124
## 84                                        0.3822445
## 94                                        0.5224378
## 104                                       0.5224378
## 108                                       0.4541017
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 7                                               FALSE
## 9                                               FALSE
## 84                                               TRUE
## 94                                              FALSE
## 104                                             FALSE
## 108                                              TRUE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 7                                             TRUE
## 9                                             TRUE
## 84                                           FALSE
## 94                                            TRUE
## 104                                           TRUE
## 108                                          FALSE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 7                                            0.5447876
## 9                                            0.5447876
## 84                                           0.3822445
## 94                                           0.5224378
## 104                                          0.5224378
## 108                                          0.4541017
##     Party.fctr.All.X.spatialSign.rcv.glmnet
## 7                                         D
## 9                                         D
## 84                                        R
## 94                                        D
## 104                                       D
## 108                                       R
##     Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 7                                      0.4361300
## 9                                      0.4841563
## 84                                     0.5476389
## 94                                     0.4935009
## 104                                    0.4871757
## 108                                    0.5102374
##     Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 7                                            FALSE
## 9                                            FALSE
## 84                                           FALSE
## 94                                            TRUE
## 104                                           TRUE
## 108                                          FALSE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 7                                          TRUE
## 9                                          TRUE
## 84                                         TRUE
## 94                                        FALSE
## 104                                       FALSE
## 108                                        TRUE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 7                                         0.5638700
## 9                                         0.5158437
## 84                                        0.5476389
## 94                                        0.4935009
## 104                                       0.4871757
## 108                                       0.5102374
##     Party.fctr.All.X..rcv.rpart Party.fctr.All.X..rcv.rpart.prob
## 7                             D                        0.3412322
## 9                             D                        0.5385802
## 84                            D                        0.4269231
## 94                            D                        0.5385802
## 104                           D                        0.5385802
## 108                           D                        0.5385802
##     Party.fctr.All.X..rcv.rpart.is.acc Party.fctr.All.X..rcv.rpart.err
## 7                                FALSE                            TRUE
## 9                                FALSE                            TRUE
## 84                                TRUE                           FALSE
## 94                                TRUE                           FALSE
## 104                               TRUE                           FALSE
## 108                               TRUE                           FALSE
##     Party.fctr.All.X..rcv.rpart.err.abs
## 7                             0.6587678
## 9                             0.4614198
## 84                            0.4269231
## 94                            0.5385802
## 104                           0.5385802
## 108                           0.5385802
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet
## 7                                       D
## 9                                       D
## 84                                      D
## 94                                      D
## 104                                     D
## 108                                     R
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## 7                                    0.5122987
## 9                                    0.5122987
## 84                                   0.4206517
## 94                                   0.5122987
## 104                                  0.5122987
## 108                                  0.5531271
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.is.acc
## 7                                          FALSE
## 9                                          FALSE
## 84                                          TRUE
## 94                                          TRUE
## 104                                         TRUE
## 108                                        FALSE
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err
## 7                                        TRUE
## 9                                        TRUE
## 84                                      FALSE
## 94                                      FALSE
## 104                                     FALSE
## 108                                      TRUE
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err.abs
## 7                                       0.4877013
## 9                                       0.4877013
## 84                                      0.4206517
## 94                                      0.5122987
## 104                                     0.5122987
## 108                                     0.5531271
##     Party.fctr.Max.cor.Y..rcv.rpart Party.fctr.Max.cor.Y..rcv.rpart.prob
## 7                                 R                            0.5212650
## 9                                 R                            0.5212650
## 84                                D                            0.4231928
## 94                                R                            0.5212650
## 104                               R                            0.5212650
## 108                               R                            0.5212650
##     Party.fctr.Max.cor.Y..rcv.rpart.is.acc
## 7                                     TRUE
## 9                                     TRUE
## 84                                    TRUE
## 94                                   FALSE
## 104                                  FALSE
## 108                                  FALSE
##     Party.fctr.Max.cor.Y..rcv.rpart.err
## 7                                 FALSE
## 9                                 FALSE
## 84                                FALSE
## 94                                 TRUE
## 104                                TRUE
## 108                                TRUE
##     Party.fctr.Max.cor.Y..rcv.rpart.err.abs
## 7                                 0.4787350
## 9                                 0.4787350
## 84                                0.4231928
## 94                                0.5212650
## 104                               0.5212650
## 108                               0.5212650
##     Party.fctr.All.X.ica.rcv.glmnet Party.fctr.All.X.ica.rcv.glmnet.prob
## 7                                 D                            0.4555972
## 9                                 D                            0.4702853
## 84                                D                            0.4625168
## 94                                D                            0.4882280
## 104                               D                            0.4795006
## 108                               D                            0.4571805
##     Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 7                                    FALSE
## 9                                    FALSE
## 84                                    TRUE
## 94                                    TRUE
## 104                                   TRUE
## 108                                   TRUE
##     Party.fctr.All.X.ica.rcv.glmnet.err
## 7                                  TRUE
## 9                                  TRUE
## 84                                FALSE
## 94                                FALSE
## 104                               FALSE
## 108                               FALSE
##     Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 7                                 0.5444028
## 9                                 0.5297147
## 84                                0.4625168
## 94                                0.4882280
## 104                               0.4795006
## 108                               0.4571805
##     Party.fctr.All.X.zv.pca.rcv.glmnet.accurate
## 7                                         FALSE
## 9                                         FALSE
## 84                                        FALSE
## 94                                        FALSE
## 104                                       FALSE
## 108                                       FALSE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.error
## 7                                -0.21039340
## 9                                -0.20735041
## 84                                0.05017299
## 94                                0.06776198
## 104                               0.08785758
## 108                               0.09705619
##     USER_ID Party.fctr Party.fctr.All.X.zv.pca.rcv.glmnet
## 164    1228          D                                  R
## 165    5604          D                                  R
## 166     521          D                                  R
## 167     442          D                                  R
## 168    5764          D                                  R
## 169    4361          D                                  R
##     Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 164                               0.7678224
## 165                               0.7795236
## 166                               0.8146192
## 167                               0.8265306
## 168                               0.8341366
## 169                               0.9053814
##     Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 164                                     FALSE
## 165                                     FALSE
## 166                                     FALSE
## 167                                     FALSE
## 168                                     FALSE
## 169                                     FALSE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 164                                   TRUE
## 165                                   TRUE
## 166                                   TRUE
## 167                                   TRUE
## 168                                   TRUE
## 169                                   TRUE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs
## 164                                  0.7678224
## 165                                  0.7795236
## 166                                  0.8146192
## 167                                  0.8265306
## 168                                  0.8341366
## 169                                  0.9053814
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet
## 164                                             R
## 165                                             R
## 166                                             R
## 167                                             R
## 168                                             R
## 169                                             R
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## 164                                          0.4993220
## 165                                          0.6371800
## 166                                          0.5754180
## 167                                          0.6346966
## 168                                          0.6214737
## 169                                          0.7246530
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.is.acc
## 164                                                FALSE
## 165                                                FALSE
## 166                                                FALSE
## 167                                                FALSE
## 168                                                FALSE
## 169                                                FALSE
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err
## 164                                              TRUE
## 165                                              TRUE
## 166                                              TRUE
## 167                                              TRUE
## 168                                              TRUE
## 169                                              TRUE
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err.abs
## 164                                             0.4993220
## 165                                             0.6371800
## 166                                             0.5754180
## 167                                             0.6346966
## 168                                             0.6214737
## 169                                             0.7246530
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 164                                      R
## 165                                      R
## 166                                      R
## 167                                      R
## 168                                      R
## 169                                      R
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 164                                   0.5290810
## 165                                   0.5169889
## 166                                   0.6466234
## 167                                   0.4892917
## 168                                   0.6813126
## 169                                   0.6860480
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 164                                         FALSE
## 165                                         FALSE
## 166                                         FALSE
## 167                                         FALSE
## 168                                         FALSE
## 169                                         FALSE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 164                                       TRUE
## 165                                       TRUE
## 166                                       TRUE
## 167                                       TRUE
## 168                                       TRUE
## 169                                       TRUE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 164                                      0.5290810
## 165                                      0.5169889
## 166                                      0.6466234
## 167                                      0.4892917
## 168                                      0.6813126
## 169                                      0.6860480
##     Party.fctr.All.X.expoTrans.rcv.glmnet
## 164                                     R
## 165                                     R
## 166                                     R
## 167                                     R
## 168                                     R
## 169                                     R
##     Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 164                                  0.5292459
## 165                                  0.5170951
## 166                                  0.6465471
## 167                                  0.4893037
## 168                                  0.6813266
## 169                                  0.6861798
##     Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 164                                        FALSE
## 165                                        FALSE
## 166                                        FALSE
## 167                                        FALSE
## 168                                        FALSE
## 169                                        FALSE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 164                                      TRUE
## 165                                      TRUE
## 166                                      TRUE
## 167                                      TRUE
## 168                                      TRUE
## 169                                      TRUE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 164                                     0.5292459
## 165                                     0.5170951
## 166                                     0.6465471
## 167                                     0.4893037
## 168                                     0.6813266
## 169                                     0.6861798
##     Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 164                            R                         0.5291337
## 165                            R                         0.5157447
## 166                            R                         0.6466044
## 167                            R                         0.4884292
## 168                            R                         0.6818120
## 169                            R                         0.6854357
##     Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 164                               FALSE                             TRUE
## 165                               FALSE                             TRUE
## 166                               FALSE                             TRUE
## 167                               FALSE                             TRUE
## 168                               FALSE                             TRUE
## 169                               FALSE                             TRUE
##     Party.fctr.All.X..rcv.glmnet.err.abs
## 164                            0.5291337
## 165                            0.5157447
## 166                            0.6466044
## 167                            0.4884292
## 168                            0.6818120
## 169                            0.6854357
##     Party.fctr.All.X.conditionalX.rcv.glmnet
## 164                                        R
## 165                                        R
## 166                                        R
## 167                                        R
## 168                                        R
## 169                                        R
##     Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 164                                     0.5291337
## 165                                     0.5157447
## 166                                     0.6466044
## 167                                     0.4884292
## 168                                     0.6818120
## 169                                     0.6854357
##     Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 164                                           FALSE
## 165                                           FALSE
## 166                                           FALSE
## 167                                           FALSE
## 168                                           FALSE
## 169                                           FALSE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 164                                         TRUE
## 165                                         TRUE
## 166                                         TRUE
## 167                                         TRUE
## 168                                         TRUE
## 169                                         TRUE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 164                                        0.5291337
## 165                                        0.5157447
## 166                                        0.6466044
## 167                                        0.4884292
## 168                                        0.6818120
## 169                                        0.6854357
##     Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 164                              R                           0.5291337
## 165                              R                           0.5157447
## 166                              R                           0.6466044
## 167                              R                           0.4884292
## 168                              R                           0.6818120
## 169                              R                           0.6854357
##     Party.fctr.All.X.zv.rcv.glmnet.is.acc
## 164                                 FALSE
## 165                                 FALSE
## 166                                 FALSE
## 167                                 FALSE
## 168                                 FALSE
## 169                                 FALSE
##     Party.fctr.All.X.zv.rcv.glmnet.err
## 164                               TRUE
## 165                               TRUE
## 166                               TRUE
## 167                               TRUE
## 168                               TRUE
## 169                               TRUE
##     Party.fctr.All.X.zv.rcv.glmnet.err.abs
## 164                              0.5291337
## 165                              0.5157447
## 166                              0.6466044
## 167                              0.4884292
## 168                              0.6818120
## 169                              0.6854357
##     Party.fctr.All.X.center.rcv.glmnet
## 164                                  R
## 165                                  R
## 166                                  R
## 167                                  R
## 168                                  R
## 169                                  R
##     Party.fctr.All.X.center.rcv.glmnet.prob
## 164                               0.5291337
## 165                               0.5157447
## 166                               0.6466044
## 167                               0.4884292
## 168                               0.6818120
## 169                               0.6854357
##     Party.fctr.All.X.center.rcv.glmnet.is.acc
## 164                                     FALSE
## 165                                     FALSE
## 166                                     FALSE
## 167                                     FALSE
## 168                                     FALSE
## 169                                     FALSE
##     Party.fctr.All.X.center.rcv.glmnet.err
## 164                                   TRUE
## 165                                   TRUE
## 166                                   TRUE
## 167                                   TRUE
## 168                                   TRUE
## 169                                   TRUE
##     Party.fctr.All.X.center.rcv.glmnet.err.abs
## 164                                  0.5291337
## 165                                  0.5157447
## 166                                  0.6466044
## 167                                  0.4884292
## 168                                  0.6818120
## 169                                  0.6854357
##     Party.fctr.All.X.scale.rcv.glmnet
## 164                                 R
## 165                                 R
## 166                                 R
## 167                                 R
## 168                                 R
## 169                                 R
##     Party.fctr.All.X.scale.rcv.glmnet.prob
## 164                              0.5291337
## 165                              0.5157447
## 166                              0.6466044
## 167                              0.4884292
## 168                              0.6818120
## 169                              0.6854357
##     Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 164                                    FALSE
## 165                                    FALSE
## 166                                    FALSE
## 167                                    FALSE
## 168                                    FALSE
## 169                                    FALSE
##     Party.fctr.All.X.scale.rcv.glmnet.err
## 164                                  TRUE
## 165                                  TRUE
## 166                                  TRUE
## 167                                  TRUE
## 168                                  TRUE
## 169                                  TRUE
##     Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 164                                 0.5291337
## 165                                 0.5157447
## 166                                 0.6466044
## 167                                 0.4884292
## 168                                 0.6818120
## 169                                 0.6854357
##     Party.fctr.All.X.center.scale.rcv.glmnet
## 164                                        R
## 165                                        R
## 166                                        R
## 167                                        R
## 168                                        R
## 169                                        R
##     Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 164                                     0.5291337
## 165                                     0.5157447
## 166                                     0.6466044
## 167                                     0.4884292
## 168                                     0.6818120
## 169                                     0.6854357
##     Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 164                                           FALSE
## 165                                           FALSE
## 166                                           FALSE
## 167                                           FALSE
## 168                                           FALSE
## 169                                           FALSE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err
## 164                                         TRUE
## 165                                         TRUE
## 166                                         TRUE
## 167                                         TRUE
## 168                                         TRUE
## 169                                         TRUE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 164                                        0.5291337
## 165                                        0.5157447
## 166                                        0.6466044
## 167                                        0.4884292
## 168                                        0.6818120
## 169                                        0.6854357
##     Party.fctr.All.X.BoxCox.rcv.glmnet
## 164                                  R
## 165                                  R
## 166                                  R
## 167                                  R
## 168                                  R
## 169                                  R
##     Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 164                               0.5291337
## 165                               0.5157447
## 166                               0.6466044
## 167                               0.4884292
## 168                               0.6818120
## 169                               0.6854357
##     Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 164                                     FALSE
## 165                                     FALSE
## 166                                     FALSE
## 167                                     FALSE
## 168                                     FALSE
## 169                                     FALSE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 164                                   TRUE
## 165                                   TRUE
## 166                                   TRUE
## 167                                   TRUE
## 168                                   TRUE
## 169                                   TRUE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 164                                  0.5291337
## 165                                  0.5157447
## 166                                  0.6466044
## 167                                  0.4884292
## 168                                  0.6818120
## 169                                  0.6854357
##     Party.fctr.All.X.range.rcv.glmnet
## 164                                 R
## 165                                 R
## 166                                 R
## 167                                 R
## 168                                 R
## 169                                 R
##     Party.fctr.All.X.range.rcv.glmnet.prob
## 164                              0.5291337
## 165                              0.5157447
## 166                              0.6466044
## 167                              0.4884292
## 168                              0.6818120
## 169                              0.6854357
##     Party.fctr.All.X.range.rcv.glmnet.is.acc
## 164                                    FALSE
## 165                                    FALSE
## 166                                    FALSE
## 167                                    FALSE
## 168                                    FALSE
## 169                                    FALSE
##     Party.fctr.All.X.range.rcv.glmnet.err
## 164                                  TRUE
## 165                                  TRUE
## 166                                  TRUE
## 167                                  TRUE
## 168                                  TRUE
## 169                                  TRUE
##     Party.fctr.All.X.range.rcv.glmnet.err.abs Party.fctr.All.X..rcv.gbm
## 164                                 0.5291337                         R
## 165                                 0.5157447                         R
## 166                                 0.6466044                         R
## 167                                 0.4884292                         R
## 168                                 0.6818120                         R
## 169                                 0.6854357                         R
##     Party.fctr.All.X..rcv.gbm.prob Party.fctr.All.X..rcv.gbm.is.acc
## 164                      0.6395130                            FALSE
## 165                      0.5894726                            FALSE
## 166                      0.5860767                            FALSE
## 167                      0.5386394                            FALSE
## 168                      0.5220881                            FALSE
## 169                      0.6500572                            FALSE
##     Party.fctr.All.X..rcv.gbm.err Party.fctr.All.X..rcv.gbm.err.abs
## 164                          TRUE                         0.6395130
## 165                          TRUE                         0.5894726
## 166                          TRUE                         0.5860767
## 167                          TRUE                         0.5386394
## 168                          TRUE                         0.5220881
## 169                          TRUE                         0.6500572
##     Party.fctr.All.X..rcv.nnet Party.fctr.All.X..rcv.nnet.prob
## 164                          R                       0.7833399
## 165                          R                       0.7833399
## 166                          R                       0.7833395
## 167                          R                       0.7821619
## 168                          R                       0.7833399
## 169                          R                       0.7833399
##     Party.fctr.All.X..rcv.nnet.is.acc Party.fctr.All.X..rcv.nnet.err
## 164                             FALSE                           TRUE
## 165                             FALSE                           TRUE
## 166                             FALSE                           TRUE
## 167                             FALSE                           TRUE
## 168                             FALSE                           TRUE
## 169                             FALSE                           TRUE
##     Party.fctr.All.X..rcv.nnet.err.abs Party.fctr.All.X..rcv.earth
## 164                          0.7833399                           R
## 165                          0.7833399                           D
## 166                          0.7833395                           R
## 167                          0.7821619                           R
## 168                          0.7833399                           R
## 169                          0.7833399                           R
##     Party.fctr.All.X..rcv.earth.prob Party.fctr.All.X..rcv.earth.is.acc
## 164                        0.6782365                              FALSE
## 165                        0.2194344                               TRUE
## 166                        0.8102143                              FALSE
## 167                        0.6096548                              FALSE
## 168                        0.8668159                              FALSE
## 169                        0.7462187                              FALSE
##     Party.fctr.All.X..rcv.earth.err Party.fctr.All.X..rcv.earth.err.abs
## 164                            TRUE                           0.6782365
## 165                           FALSE                           0.2194344
## 166                            TRUE                           0.8102143
## 167                            TRUE                           0.6096548
## 168                            TRUE                           0.8668159
## 169                            TRUE                           0.7462187
##     Party.fctr.All.X..rcv.bayesglm Party.fctr.All.X..rcv.bayesglm.prob
## 164                              R                           0.9533973
## 165                              R                           0.7787490
## 166                              R                           0.9345485
## 167                              R                           0.8563059
## 168                              R                           0.9725751
## 169                              R                           0.8282327
##     Party.fctr.All.X..rcv.bayesglm.is.acc
## 164                                 FALSE
## 165                                 FALSE
## 166                                 FALSE
## 167                                 FALSE
## 168                                 FALSE
## 169                                 FALSE
##     Party.fctr.All.X..rcv.bayesglm.err
## 164                               TRUE
## 165                               TRUE
## 166                               TRUE
## 167                               TRUE
## 168                               TRUE
## 169                               TRUE
##     Party.fctr.All.X..rcv.bayesglm.err.abs Party.fctr.All.X..rcv.glm
## 164                              0.9533973                         R
## 165                              0.7787490                         R
## 166                              0.9345485                         R
## 167                              0.8563059                         R
## 168                              0.9725751                         R
## 169                              0.8282327                         R
##     Party.fctr.All.X..rcv.glm.prob Party.fctr.All.X..rcv.glm.is.acc
## 164                      0.9609734                            FALSE
## 165                      0.7837619                            FALSE
## 166                      0.9385226                            FALSE
## 167                      0.8725010                            FALSE
## 168                      0.9760882                            FALSE
## 169                      0.8168588                            FALSE
##     Party.fctr.All.X..rcv.glm.err Party.fctr.All.X..rcv.glm.err.abs
## 164                          TRUE                         0.9609734
## 165                          TRUE                         0.7837619
## 166                          TRUE                         0.9385226
## 167                          TRUE                         0.8725010
## 168                          TRUE                         0.9760882
## 169                          TRUE                         0.8168588
##     Party.fctr.All.X..rcv.bagEarth Party.fctr.All.X..rcv.bagEarth.prob
## 164                              R                           0.7918284
## 165                              D                           0.4952871
## 166                              R                           0.8840314
## 167                              R                           0.7778852
## 168                              R                           0.8983007
## 169                              R                           0.7143307
##     Party.fctr.All.X..rcv.bagEarth.is.acc
## 164                                 FALSE
## 165                                  TRUE
## 166                                 FALSE
## 167                                 FALSE
## 168                                 FALSE
## 169                                 FALSE
##     Party.fctr.All.X..rcv.bagEarth.err
## 164                               TRUE
## 165                              FALSE
## 166                               TRUE
## 167                               TRUE
## 168                               TRUE
## 169                               TRUE
##     Party.fctr.All.X..rcv.bagEarth.err.abs Party.fctr.All.X.nzv.rcv.glmnet
## 164                              0.7918284                               R
## 165                              0.4952871                               R
## 166                              0.8840314                               R
## 167                              0.7778852                               R
## 168                              0.8983007                               R
## 169                              0.7143307                               R
##     Party.fctr.All.X.nzv.rcv.glmnet.prob
## 164                            0.5272872
## 165                            0.5413561
## 166                            0.6410476
## 167                            0.4908711
## 168                            0.6811904
## 169                            0.6841193
##     Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 164                                  FALSE
## 165                                  FALSE
## 166                                  FALSE
## 167                                  FALSE
## 168                                  FALSE
## 169                                  FALSE
##     Party.fctr.All.X.nzv.rcv.glmnet.err
## 164                                TRUE
## 165                                TRUE
## 166                                TRUE
## 167                                TRUE
## 168                                TRUE
## 169                                TRUE
##     Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.All.X..rcv.rf
## 164                               0.5272872                        D
## 165                               0.5413561                        R
## 166                               0.6410476                        R
## 167                               0.4908711                        D
## 168                               0.6811904                        D
## 169                               0.6841193                        R
##     Party.fctr.All.X..rcv.rf.prob Party.fctr.All.X..rcv.rf.is.acc
## 164                         0.542                            TRUE
## 165                         0.576                           FALSE
## 166                         0.558                           FALSE
## 167                         0.534                            TRUE
## 168                         0.534                            TRUE
## 169                         0.646                           FALSE
##     Party.fctr.All.X..rcv.rf.err Party.fctr.All.X..rcv.rf.err.abs
## 164                        FALSE                            0.542
## 165                         TRUE                            0.576
## 166                         TRUE                            0.558
## 167                        FALSE                            0.534
## 168                        FALSE                            0.534
## 169                         TRUE                            0.646
##     Party.fctr.All.X..rcv.avNNet Party.fctr.All.X..rcv.avNNet.prob
## 164                            R                         0.8138027
## 165                            R                         0.7978068
## 166                            R                         0.8733543
## 167                            R                         0.6865139
## 168                            R                         0.5703041
## 169                            R                         0.7536152
##     Party.fctr.All.X..rcv.avNNet.is.acc Party.fctr.All.X..rcv.avNNet.err
## 164                               FALSE                             TRUE
## 165                               FALSE                             TRUE
## 166                               FALSE                             TRUE
## 167                               FALSE                             TRUE
## 168                               FALSE                             TRUE
## 169                               FALSE                             TRUE
##     Party.fctr.All.X..rcv.avNNet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 164                            0.8138027                                R
## 165                            0.7978068                                R
## 166                            0.8733543                                R
## 167                            0.6865139                                R
## 168                            0.5703041                                R
## 169                            0.7536152                                R
##     Party.fctr.Low.cor.X..rcv.glmnet.prob
## 164                             0.5290488
## 165                             0.5363182
## 166                             0.6337145
## 167                             0.4969215
## 168                             0.6860919
## 169                             0.7062437
##     Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 164                                   FALSE
## 165                                   FALSE
## 166                                   FALSE
## 167                                   FALSE
## 168                                   FALSE
## 169                                   FALSE
##     Party.fctr.Low.cor.X..rcv.glmnet.err
## 164                                 TRUE
## 165                                 TRUE
## 166                                 TRUE
## 167                                 TRUE
## 168                                 TRUE
## 169                                 TRUE
##     Party.fctr.Low.cor.X..rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.glmnet
## 164                                0.5290488                            R
## 165                                0.5363182                            R
## 166                                0.6337145                            R
## 167                                0.4969215                            D
## 168                                0.6860919                            R
## 169                                0.7062437                            R
##     Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 164                         0.6466448                               FALSE
## 165                         0.6870107                               FALSE
## 166                         0.6256010                               FALSE
## 167                         0.3944287                                TRUE
## 168                         0.6718509                               FALSE
## 169                         0.7874528                               FALSE
##     Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 164                             TRUE                            0.6466448
## 165                             TRUE                            0.6870107
## 166                             TRUE                            0.6256010
## 167                            FALSE                            0.3944287
## 168                             TRUE                            0.6718509
## 169                             TRUE                            0.7874528
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 164                                          D
## 165                                          R
## 166                                          R
## 167                                          D
## 168                                          D
## 169                                          R
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 164                                       0.3472782
## 165                                       0.5532471
## 166                                       0.5570163
## 167                                       0.3474860
## 168                                       0.4459434
## 169                                       0.5249303
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 164                                              TRUE
## 165                                             FALSE
## 166                                             FALSE
## 167                                              TRUE
## 168                                              TRUE
## 169                                             FALSE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 164                                          FALSE
## 165                                           TRUE
## 166                                           TRUE
## 167                                          FALSE
## 168                                          FALSE
## 169                                           TRUE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 164                                          0.3472782
## 165                                          0.5532471
## 166                                          0.5570163
## 167                                          0.3474860
## 168                                          0.4459434
## 169                                          0.5249303
##     Party.fctr.All.X.spatialSign.rcv.glmnet
## 164                                       R
## 165                                       D
## 166                                       R
## 167                                       D
## 168                                       R
## 169                                       R
##     Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 164                                    0.5018674
## 165                                    0.4729820
## 166                                    0.5543791
## 167                                    0.4571849
## 168                                    0.5932020
## 169                                    0.6301253
##     Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 164                                          FALSE
## 165                                           TRUE
## 166                                          FALSE
## 167                                           TRUE
## 168                                          FALSE
## 169                                          FALSE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 164                                        TRUE
## 165                                       FALSE
## 166                                        TRUE
## 167                                       FALSE
## 168                                        TRUE
## 169                                        TRUE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 164                                       0.5018674
## 165                                       0.4729820
## 166                                       0.5543791
## 167                                       0.4571849
## 168                                       0.5932020
## 169                                       0.6301253
##     Party.fctr.All.X..rcv.rpart Party.fctr.All.X..rcv.rpart.prob
## 164                           D                        0.2330827
## 165                           R                        0.6225490
## 166                           R                        0.6225490
## 167                           D                        0.4269231
## 168                           R                        0.6225490
## 169                           R                        0.6225490
##     Party.fctr.All.X..rcv.rpart.is.acc Party.fctr.All.X..rcv.rpart.err
## 164                               TRUE                           FALSE
## 165                              FALSE                            TRUE
## 166                              FALSE                            TRUE
## 167                               TRUE                           FALSE
## 168                              FALSE                            TRUE
## 169                              FALSE                            TRUE
##     Party.fctr.All.X..rcv.rpart.err.abs
## 164                           0.2330827
## 165                           0.6225490
## 166                           0.6225490
## 167                           0.4269231
## 168                           0.6225490
## 169                           0.6225490
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet
## 164                                     D
## 165                                     R
## 166                                     D
## 167                                     D
## 168                                     D
## 169                                     R
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## 164                                  0.3479286
## 165                                  0.5531271
## 166                                  0.4610815
## 167                                  0.4206517
## 168                                  0.4610815
## 169                                  0.5531271
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.is.acc
## 164                                         TRUE
## 165                                        FALSE
## 166                                         TRUE
## 167                                         TRUE
## 168                                         TRUE
## 169                                        FALSE
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err
## 164                                     FALSE
## 165                                      TRUE
## 166                                     FALSE
## 167                                     FALSE
## 168                                     FALSE
## 169                                      TRUE
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err.abs
## 164                                     0.3479286
## 165                                     0.5531271
## 166                                     0.4610815
## 167                                     0.4206517
## 168                                     0.4610815
## 169                                     0.5531271
##     Party.fctr.Max.cor.Y..rcv.rpart Party.fctr.Max.cor.Y..rcv.rpart.prob
## 164                               D                            0.3000000
## 165                               R                            0.5212650
## 166                               D                            0.4231928
## 167                               D                            0.4231928
## 168                               D                            0.4231928
## 169                               R                            0.5212650
##     Party.fctr.Max.cor.Y..rcv.rpart.is.acc
## 164                                   TRUE
## 165                                  FALSE
## 166                                   TRUE
## 167                                   TRUE
## 168                                   TRUE
## 169                                  FALSE
##     Party.fctr.Max.cor.Y..rcv.rpart.err
## 164                               FALSE
## 165                                TRUE
## 166                               FALSE
## 167                               FALSE
## 168                               FALSE
## 169                                TRUE
##     Party.fctr.Max.cor.Y..rcv.rpart.err.abs
## 164                               0.3000000
## 165                               0.5212650
## 166                               0.4231928
## 167                               0.4231928
## 168                               0.4231928
## 169                               0.5212650
##     Party.fctr.All.X.ica.rcv.glmnet Party.fctr.All.X.ica.rcv.glmnet.prob
## 164                               D                            0.4460768
## 165                               D                            0.4407212
## 166                               D                            0.4507304
## 167                               D                            0.4481071
## 168                               D                            0.4492702
## 169                               D                            0.4612744
##     Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 164                                   TRUE
## 165                                   TRUE
## 166                                   TRUE
## 167                                   TRUE
## 168                                   TRUE
## 169                                   TRUE
##     Party.fctr.All.X.ica.rcv.glmnet.err
## 164                               FALSE
## 165                               FALSE
## 166                               FALSE
## 167                               FALSE
## 168                               FALSE
## 169                               FALSE
##     Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 164                               0.4460768
## 165                               0.4407212
## 166                               0.4507304
## 167                               0.4481071
## 168                               0.4492702
## 169                               0.4612744
##     Party.fctr.All.X.zv.pca.rcv.glmnet.accurate
## 164                                       FALSE
## 165                                       FALSE
## 166                                       FALSE
## 167                                       FALSE
## 168                                       FALSE
## 169                                       FALSE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.error
## 164                                0.3178224
## 165                                0.3295236
## 166                                0.3646192
## 167                                0.3765306
## 168                                0.3841366
## 169                                0.4553814

##     Hhold.fctr .n.OOB .n.Fit .n.Tst .freqRatio.Fit .freqRatio.OOB
## PKy        PKy      2     28      2     0.01608271    0.004514673
## N            N     48    209     59     0.12004595    0.108352144
## MKn        MKn     40    188     49     0.10798392    0.090293454
## SKn        SKn    222    781    276     0.44859276    0.501128668
## PKn        PKn     11     56     12     0.03216542    0.024830700
## SKy        SKy     23     47     28     0.02699598    0.051918736
## MKy        MKy     97    432    121     0.24813326    0.218961625
##     .freqRatio.Tst err.abs.fit.sum err.abs.fit.mean .n.fit err.abs.OOB.sum
## PKy    0.003656307        11.86102        0.4236078     28        1.086637
## N      0.107861060        92.23300        0.4413062    209       24.689085
## MKn    0.089579525        80.88852        0.4302581    188       19.089443
## SKn    0.504570384       340.18513        0.4355763    781      103.541909
## PKn    0.021937843        23.02028        0.4110764     56        4.839375
## SKy    0.051188300        19.44426        0.4137076     47        9.778182
## MKy    0.221206581       190.10070        0.4400479    432       40.247267
##     err.abs.OOB.mean
## PKy        0.5433185
## N          0.5143559
## MKn        0.4772361
## SKn        0.4664050
## PKn        0.4399432
## SKy        0.4251384
## MKy        0.4149203
##           .n.OOB           .n.Fit           .n.Tst   .freqRatio.Fit 
##       443.000000      1741.000000       547.000000         1.000000 
##   .freqRatio.OOB   .freqRatio.Tst  err.abs.fit.sum err.abs.fit.mean 
##         1.000000         1.000000       757.732903         2.995580 
##           .n.fit  err.abs.OOB.sum err.abs.OOB.mean 
##      1741.000000       203.271898         3.281317
##              label step_major step_minor label_minor     bgn end elapsed
## 1 fit.models_2_bgn          1          0    teardown 436.293  NA      NA
##          label step_major step_minor label_minor     bgn     end elapsed
## 1 fit.models_2          1          0           0   9.814 436.304  426.49
## 2   fit.models          1          1           1 436.304      NA      NA
# if (sum(is.na(glbObsAll$D.P.http)) > 0)
#         stop("fit.models_3: Why is this happening ?")

#stop(here"); glb2Sav()
sync_glb_obs_df <- function() {
    # Merge or cbind ?
    for (col in setdiff(names(glbObsFit), names(glbObsTrn)))
        glbObsTrn[glbObsTrn$.lcn == "Fit", col] <<- glbObsFit[, col]
    for (col in setdiff(names(glbObsFit), names(glbObsAll)))
        glbObsAll[glbObsAll$.lcn == "Fit", col] <<- glbObsFit[, col]
    if (all(is.na(glbObsNew[, glb_rsp_var])))
        for (col in setdiff(names(glbObsOOB), names(glbObsTrn)))
            glbObsTrn[glbObsTrn$.lcn == "OOB", col] <<- glbObsOOB[, col]
    for (col in setdiff(names(glbObsOOB), names(glbObsAll)))
        glbObsAll[glbObsAll$.lcn == "OOB", col] <<- glbObsOOB[, col]
}
sync_glb_obs_df()
    
print(setdiff(names(glbObsNew), names(glbObsAll)))
## character(0)
replay.petrisim(pn = glb_analytics_pn, 
    replay.trans = (glb_analytics_avl_objs <- c(glb_analytics_avl_objs, 
        "model.selected")), flip_coord = TRUE)
## time trans    "bgn " "fit.data.training.all " "predict.data.new " "end " 
## 0.0000   multiple enabled transitions:  data.training.all data.new model.selected    firing:  model.selected 
## 1.0000    3   2 1 0 0

glb_chunks_df <- myadd_chunk(glb_chunks_df, "fit.data.training", major.inc = TRUE)
##               label step_major step_minor label_minor     bgn     end
## 2        fit.models          1          1           1 436.304 473.075
## 3 fit.data.training          2          0           0 473.076      NA
##   elapsed
## 2  36.771
## 3      NA

Step 2.0: fit data training

```{r fit.data.training_0, cache=FALSE, eval=myevlChunk(glbChunks, glbOut$pfx)}

## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Final.All.X#zv.pca##glmnet"
## [1] "    indepVar: Gender.fctr,Q113181.fctr,Q120472.fctr,Q115611.fctr,Q120650.fctr,Q118237.fctr,.rnorm,Q122120.fctr,Q110740.fctr,Q122770.fctr,Q118117.fctr,Income.fctr,Q116441.fctr,Q118233.fctr,Q106272.fctr,Q119650.fctr,Q124742.fctr,Q122771.fctr,Q99480.fctr,Q116197.fctr,Q116881.fctr,Q101596.fctr,Q122769.fctr,Q108855.fctr,Q120014.fctr,Q119334.fctr,Q106993.fctr,Q107869.fctr,Q121011.fctr,Q117186.fctr,Q106997.fctr,Q108617.fctr,Q98197.fctr,Q106042.fctr,Q115777.fctr,Q123621.fctr,Q106388.fctr,Q114152.fctr,Q124122.fctr,Q120194.fctr,Q116797.fctr,Q105655.fctr,Q115899.fctr,Q116448.fctr,Q117193.fctr,Q108754.fctr,Q108856.fctr,YOB.Age.fctr,Q123464.fctr,Q99581.fctr,Q114961.fctr,Q104996.fctr,Q108343.fctr,Q120012.fctr,Q120978.fctr,Q98578.fctr,Q103293.fctr,Q106389.fctr,Q98869.fctr,Q112512.fctr,Q116953.fctr,Q100010.fctr,Q111220.fctr,Q102906.fctr,Q121700.fctr,Q112478.fctr,Q115610.fctr,Q119851.fctr,Q114517.fctr,Q118892.fctr,Q115602.fctr,Q120379.fctr,Q107491.fctr,Q114748.fctr,Q99982.fctr,Q113992.fctr,Q115390.fctr,Q118232.fctr,Q96024.fctr,Q115195.fctr,Q121699.fctr,Q100680.fctr,Q111580.fctr,Q102289.fctr,Q102687.fctr,Q105840.fctr,Q101162.fctr,Q108950.fctr,Q116601.fctr,Q108342.fctr,Q100562.fctr,Q113584.fctr,Q109367.fctr,Q99716.fctr,Hhold.fctr,Q112270.fctr,Q98059.fctr,Q111848.fctr,Q102674.fctr,Q114386.fctr,Q98078.fctr,Q102089.fctr,Edn.fctr,Q100689.fctr,Q113583.fctr,Q101163.fctr,YOB.Age.fctr:YOB.Age.dff,Hhold.fctr:.clusterid.fctr"
## [1] "myfit_mdl: setup complete: 0.686000 secs"
## Fitting alpha = 1, lambda = 0.00483 on full training set
## [1] "myfit_mdl: train complete: 2.898000 secs"
##   alpha      lambda
## 1     1 0.004831424

##             Length Class      Mode     
## a0             58  -none-     numeric  
## beta        10556  dgCMatrix  S4       
## df             58  -none-     numeric  
## dim             2  -none-     numeric  
## lambda         58  -none-     numeric  
## dev.ratio      58  -none-     numeric  
## nulldev         1  -none-     numeric  
## npasses         1  -none-     numeric  
## jerr            1  -none-     numeric  
## offset          1  -none-     logical  
## classnames      2  -none-     character
## call            5  -none-     call     
## nobs            1  -none-     numeric  
## lambdaOpt       1  -none-     numeric  
## xNames        182  -none-     character
## problemType     1  -none-     character
## tuneValue       2  data.frame list     
## obsLevels       2  -none-     character
## [1] "min lambda > lambdaOpt:"
##   (Intercept)           PC1           PC2           PC3           PC4 
## -0.1591266088  0.0056887367 -0.0103859510  0.0035588699 -0.0219267475 
##           PC5           PC6           PC7           PC8           PC9 
## -0.0066849895 -0.0598062508 -0.0482160606 -0.0581889324  0.0448232402 
##          PC10          PC11          PC12          PC13          PC14 
## -0.0350643155  0.0371413810 -0.0854766939  0.0066907174  0.0403796774 
##          PC16          PC17          PC18          PC19          PC20 
##  0.0521072386  0.0709349014 -0.0860161171  0.0073930748 -0.0700097858 
##          PC21          PC23          PC24          PC25          PC26 
## -0.1280665474  0.0197339205 -0.0408908333 -0.0397539461 -0.0971789995 
##          PC27          PC28          PC29          PC30          PC31 
##  0.0732056606  0.1343132343  0.0039898095 -0.0026953742  0.0699219380 
##          PC32          PC33          PC34          PC35          PC36 
##  0.0285825570  0.0221678143 -0.0175990531  0.0117230967 -0.1010646025 
##          PC37          PC38          PC39          PC40          PC41 
##  0.0055146929 -0.0310598357 -0.0017471865 -0.0146229739  0.0393952728 
##          PC42          PC44          PC46          PC47          PC48 
##  0.0022148978  0.0350391346 -0.0501189107 -0.0414029752 -0.0433869219 
##          PC50          PC51          PC52          PC54          PC56 
## -0.0502118164 -0.0266007357 -0.0255610772 -0.0409799652  0.0133343384 
##          PC57          PC58          PC60          PC62          PC63 
##  0.0033708199  0.0194648764  0.0399701966  0.0223046478 -0.0360286866 
##          PC65          PC66          PC67          PC68          PC71 
## -0.0415030568 -0.0581380119 -0.0228599003 -0.0189799969  0.0066387100 
##          PC72          PC73          PC74          PC75          PC77 
##  0.0002887040 -0.0281152726 -0.0274444819  0.0249713611 -0.0552244390 
##          PC78          PC79          PC82          PC83          PC85 
##  0.0415286370 -0.0762107792  0.0118528317  0.0360564237 -0.0649950908 
##          PC86          PC88          PC89          PC91          PC92 
##  0.0239552648  0.0161510247  0.0090843181 -0.0092934852  0.0831083324 
##          PC95          PC96          PC97          PC99         PC100 
##  0.0197281927  0.0186335740 -0.0062904552 -0.0113108262  0.0005774036 
##         PC101         PC102         PC104         PC105         PC108 
## -0.0322857384  0.0058843162  0.0183418917  0.0092537655  0.0081334686 
##         PC110         PC113         PC114         PC116         PC119 
##  0.0205033835  0.0518824161  0.0039290960  0.1123784342  0.0006620032 
##         PC120         PC121         PC122         PC125         PC126 
##  0.1040528950 -0.0511486720 -0.0069931418  0.0995775916 -0.0332400787 
##         PC127         PC128         PC129         PC130         PC132 
##  0.0381761005 -0.0145211308 -0.0136657358 -0.1894323884 -0.0749643789 
##         PC133         PC134         PC135         PC136         PC137 
##  0.0027636073  0.1176847710 -0.0330382805  0.0682541648  0.0304893045 
##         PC138         PC139         PC140         PC141         PC142 
## -0.0032542492 -0.0920532477  0.0515897373 -0.0245345816  0.0496099920 
##         PC143         PC144         PC145         PC147         PC148 
## -0.0870955874 -0.0248681357 -0.0408310464  0.0341540564 -0.0370107885 
##         PC150         PC152         PC153         PC155         PC156 
##  0.0205808999 -0.0445828530 -0.0325605129 -0.0152881787 -0.0330635169 
##         PC157         PC158         PC160         PC161         PC162 
## -0.0071342172 -0.0389545194 -0.0069877206  0.0220684679  0.0246944264 
##         PC163         PC164         PC166         PC168         PC170 
##  0.0301294173 -0.0385349603  0.0928220627 -0.0306418576  0.0873588071 
##         PC171         PC172         PC174         PC175         PC176 
##  0.0229927506 -0.0116091236  0.0046850935  0.0095249805 -0.0735594141 
##         PC177         PC182 
##  0.0380694016  0.0564081066 
## [1] "max lambda < lambdaOpt:"
##   (Intercept)           PC1           PC2           PC3           PC4 
## -0.1601657287  0.0062267080 -0.0111243065  0.0044831053 -0.0230088252 
##           PC5           PC6           PC7           PC8           PC9 
## -0.0078158996 -0.0613640259 -0.0497104400 -0.0597637921  0.0462772520 
##          PC10          PC11          PC12          PC13          PC14 
## -0.0366315800  0.0386915099 -0.0872591999  0.0078516352  0.0417232654 
##          PC16          PC17          PC18          PC19          PC20 
##  0.0536405876  0.0727402884 -0.0879746373  0.0089196757 -0.0720616735 
##          PC21          PC23          PC24          PC25          PC26 
## -0.1305844995  0.0215793400 -0.0426342129 -0.0417908271 -0.0997330788 
##          PC27          PC28          PC29          PC30          PC31 
##  0.0750982436  0.1368758440  0.0058364679 -0.0044478594  0.0722709918 
##          PC32          PC33          PC34          PC35          PC36 
##  0.0302922052  0.0238694691 -0.0193954396  0.0134972962 -0.1035510364 
##          PC37          PC38          PC39          PC40          PC41 
##  0.0074226969 -0.0332001975 -0.0037741683 -0.0164075165  0.0412813138 
##          PC42          PC44          PC46          PC47          PC48 
##  0.0043421821  0.0370412255 -0.0526100507 -0.0437860138 -0.0455049975 
##          PC50          PC51          PC52          PC54          PC56 
## -0.0524004773 -0.0287422099 -0.0272509836 -0.0429478023  0.0152053968 
##          PC57          PC58          PC60          PC62          PC63 
##  0.0053090176  0.0218098465  0.0423458740  0.0245692213 -0.0383528942 
##          PC65          PC66          PC67          PC68          PC71 
## -0.0435383065 -0.0604700330 -0.0250187812 -0.0208480528  0.0085293542 
##          PC72          PC73          PC74          PC75          PC77 
##  0.0021734913 -0.0303572964 -0.0298869046  0.0270125555 -0.0576174393 
##          PC78          PC79          PC82          PC83          PC85 
##  0.0439593778 -0.0784856941  0.0141978249  0.0384044311 -0.0676369638 
##          PC86          PC88          PC89          PC91          PC92 
##  0.0260575697  0.0180574867  0.0113303961 -0.0113257837  0.0860658818 
##          PC95          PC96          PC97          PC99         PC100 
##  0.0222330243  0.0208288902 -0.0082615277 -0.0137603494  0.0028891398 
##         PC101         PC102         PC104         PC105         PC108 
## -0.0347639791  0.0080273851  0.0208487961  0.0116826412  0.0101953779 
##         PC109         PC110         PC113         PC114         PC116 
##  0.0019911546  0.0229095528  0.0546154480  0.0060032665  0.1154485083 
##         PC118         PC119         PC120         PC121         PC122 
##  0.0003549896  0.0029647136  0.1070096229 -0.0538174497 -0.0095126023 
##         PC124         PC125         PC126         PC127         PC128 
##  0.0005681740  0.1026587464 -0.0358313075  0.0407584236 -0.0167665288 
##         PC129         PC130         PC132         PC133         PC134 
## -0.0164500659 -0.1930744085 -0.0778911988  0.0051535517  0.1212684291 
##         PC135         PC136         PC137         PC138         PC139 
## -0.0361099291  0.0712382432  0.0330846510 -0.0053210975 -0.0950287253 
##         PC140         PC141         PC142         PC143         PC144 
##  0.0545989916 -0.0270902040  0.0527166158 -0.0906183169 -0.0280278977 
##         PC145         PC147         PC148         PC150         PC152 
## -0.0434974124  0.0371048177 -0.0403003428  0.0231176420 -0.0475514946 
##         PC153         PC155         PC156         PC157         PC158 
## -0.0353295694 -0.0182774707 -0.0356644573 -0.0102308773 -0.0420719006 
##         PC160         PC161         PC162         PC163         PC164 
## -0.0100195202  0.0247051675  0.0276509726  0.0332599437 -0.0416921064 
##         PC166         PC168         PC170         PC171         PC172 
##  0.0968145490 -0.0342355110  0.0912963116  0.0263486700 -0.0152148853 
##         PC173         PC174         PC175         PC176         PC177 
## -0.0009413444  0.0075039326  0.0130041039 -0.0771322356  0.0417479410 
##         PC178         PC182 
## -0.0015044841  0.0609023718 
## [1] "myfit_mdl: train diagnostics complete: 2.961000 secs"

##          Prediction
## Reference   D   R
##         D 725 446
##         R 286 727
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   6.648352e-01   3.332483e-01   6.445978e-01   6.846293e-01   5.361722e-01 
## AccuracyPValue  McnemarPValue 
##   1.940095e-34   4.182500e-09 
## [1] "myfit_mdl: predict complete: 8.579000 secs"
##                           id
## 1 Final.All.X#zv.pca##glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           feats
## 1 Gender.fctr,Q113181.fctr,Q120472.fctr,Q115611.fctr,Q120650.fctr,Q118237.fctr,.rnorm,Q122120.fctr,Q110740.fctr,Q122770.fctr,Q118117.fctr,Income.fctr,Q116441.fctr,Q118233.fctr,Q106272.fctr,Q119650.fctr,Q124742.fctr,Q122771.fctr,Q99480.fctr,Q116197.fctr,Q116881.fctr,Q101596.fctr,Q122769.fctr,Q108855.fctr,Q120014.fctr,Q119334.fctr,Q106993.fctr,Q107869.fctr,Q121011.fctr,Q117186.fctr,Q106997.fctr,Q108617.fctr,Q98197.fctr,Q106042.fctr,Q115777.fctr,Q123621.fctr,Q106388.fctr,Q114152.fctr,Q124122.fctr,Q120194.fctr,Q116797.fctr,Q105655.fctr,Q115899.fctr,Q116448.fctr,Q117193.fctr,Q108754.fctr,Q108856.fctr,YOB.Age.fctr,Q123464.fctr,Q99581.fctr,Q114961.fctr,Q104996.fctr,Q108343.fctr,Q120012.fctr,Q120978.fctr,Q98578.fctr,Q103293.fctr,Q106389.fctr,Q98869.fctr,Q112512.fctr,Q116953.fctr,Q100010.fctr,Q111220.fctr,Q102906.fctr,Q121700.fctr,Q112478.fctr,Q115610.fctr,Q119851.fctr,Q114517.fctr,Q118892.fctr,Q115602.fctr,Q120379.fctr,Q107491.fctr,Q114748.fctr,Q99982.fctr,Q113992.fctr,Q115390.fctr,Q118232.fctr,Q96024.fctr,Q115195.fctr,Q121699.fctr,Q100680.fctr,Q111580.fctr,Q102289.fctr,Q102687.fctr,Q105840.fctr,Q101162.fctr,Q108950.fctr,Q116601.fctr,Q108342.fctr,Q100562.fctr,Q113584.fctr,Q109367.fctr,Q99716.fctr,Hhold.fctr,Q112270.fctr,Q98059.fctr,Q111848.fctr,Q102674.fctr,Q114386.fctr,Q98078.fctr,Q102089.fctr,Edn.fctr,Q100689.fctr,Q113583.fctr,Q101163.fctr,YOB.Age.fctr:YOB.Age.dff,Hhold.fctr:.clusterid.fctr
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1               0                      2.118                 1.247
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.6576892    0.7438087    0.5715696       0.7246184
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                   0.45       0.6651418        0.6648352
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.6445978             0.6846293     0.3332483
## [1] "myfit_mdl: exit: 8.624000 secs"
##               label step_major step_minor label_minor     bgn     end
## 3 fit.data.training          2          0           0 473.076 482.191
## 4 fit.data.training          2          1           1 482.192      NA
##   elapsed
## 3   9.115
## 4      NA
#stop(here"); glb2Sav()
if (glb_is_classification && glb_is_binomial) 
    prob_threshold <- glb_models_df[glb_models_df$id == glbMdlSelId,
                                        "opt.prob.threshold.OOB"] else 
    prob_threshold <- NULL

if (grepl("Ensemble", glbMdlFinId)) {
    # Get predictions for each model in ensemble; Outliers that have been moved to OOB might not have been predicted yet
    mdlEnsembleComps <- unlist(str_split(subset(glb_models_df, 
                                                id == glbMdlFinId)$feats, ","))
    if (glb_is_classification)
    #     mdlEnsembleComps <- gsub("\\.prob$", "", mdlEnsembleComps)
    # mdlEnsembleComps <- gsub(paste0("^", 
    #                     gsub(".", "\\.", mygetPredictIds(glb_rsp_var)$value, fixed = TRUE)),
    #                          "", mdlEnsembleComps)
        mdlEnsembleComps <- glb_models_df$id[sapply(glb_models_df$id, function(thsMdlId)
                        mygetPredictIds(glb_rsp_var, thsMdlId)$prob  %in% mdlEnsembleComps)] else
        mdlEnsembleComps <- glb_models_df$id[sapply(glb_models_df$id, function(thsMdlId)
                        mygetPredictIds(glb_rsp_var, thsMdlId)$value  %in% mdlEnsembleComps)]
                        
    for (mdl_id in mdlEnsembleComps) {
        glbObsTrn <- glb_get_predictions(df = glbObsTrn, mdl_id = mdl_id, 
                                            rsp_var = glb_rsp_var,
                                            prob_threshold_def = prob_threshold)
        glbObsNew <- glb_get_predictions(df = glbObsNew, mdl_id = mdl_id, 
                                            rsp_var = glb_rsp_var,
                                            prob_threshold_def = prob_threshold)
        # glb_fin_mdl uses the same coefficients as glb_sel_mdl, 
        #   so copy the "Final" columns into "non-Final" columns
        glbObsTrn[, gsub("Final.", "", unlist(mygetPredictIds(glb_rsp_var, mdl_id)))] <-
            glbObsTrn[, unlist(mygetPredictIds(glb_rsp_var, mdl_id))]
        glbObsNew[, gsub("Final.", "", unlist(mygetPredictIds(glb_rsp_var, mdl_id)))] <-
            glbObsNew[, unlist(mygetPredictIds(glb_rsp_var, mdl_id))]
    }    
}
glbObsTrn <- glb_get_predictions(df = glbObsTrn, mdl_id = glbMdlFinId, 
                                     rsp_var = glb_rsp_var,
                                    prob_threshold_def = prob_threshold)
## Warning in glb_get_predictions(df = glbObsTrn, mdl_id = glbMdlFinId,
## rsp_var = glb_rsp_var, : Using default probability threshold: 0.45
glb_featsimp_df <- myget_feats_importance(mdl=glb_fin_mdl,
                                          featsimp_df=glb_featsimp_df)
#glb_featsimp_df[, paste0(glbMdlFinId, ".imp")] <- glb_featsimp_df$imp
print(glb_featsimp_df)
##       All.X.zv.pca.rcv.glmnet.imp Final.All.X.zv.pca..glmnet.imp
## PC130                6.950057e+01                    100.0000000
## PC28                 2.888611e+01                     70.8946101
## PC21                 4.988859e+01                     67.6291473
## PC134                0.000000e+00                     62.6873757
## PC116                0.000000e+00                     59.7109782
## PC120                2.489996e+01                     55.3358766
## PC36                 1.345465e+01                     53.5826145
## PC125                0.000000e+00                     53.0630014
## PC26                 2.038367e+01                     51.5920368
## PC166                5.488771e+01                     49.9400943
## PC139                4.823095e+00                     49.1075520
## PC170                7.479393e+01                     47.0773911
## PC143                9.275090e+01                     46.7640067
## PC18                 2.357931e+01                     45.5370482
## PC12                 8.425935e-03                     45.1817693
## PC92                 3.818783e+00                     44.4511794
## PC79                 7.362601e+00                     40.5758428
## PC132                1.432095e+01                     40.2056225
## PC176                1.000000e+02                     39.7504818
## PC27                 4.033550e+01                     38.8512853
## PC17                 4.985385e+01                     37.6340316
## PC31                 0.000000e+00                     37.3390487
## PC20                 5.129963e+01                     37.2581878
## PC136                2.984962e+01                     36.7426511
## PC85                 0.000000e+00                     34.9031946
## PC6                  3.450937e+01                     31.7449693
## PC182                          NA                     31.2291154
## PC66                 1.699096e+01                     31.2076021
## PC8                  3.601150e+01                     30.9117104
## PC77                 1.028165e+01                     29.7193577
## PC113                4.852200e+01                     28.1272489
## PC140                0.000000e+00                     28.0927410
## PC16                 8.520516e+01                     27.7333355
## PC121                0.000000e+00                     27.7185609
## PC46                 0.000000e+00                     27.1077584
## PC142                6.509297e-01                     27.1053068
## PC50                 0.000000e+00                     27.0272641
## PC7                  2.909991e+01                     25.6944700
## PC152                1.613821e+01                     24.4339200
## PC9                  3.351613e+01                     23.9140094
## PC48                 1.022987e+01                     23.4502639
## PC78                 6.978608e+01                     22.6176140
## PC47                 4.830536e+01                     22.5319977
## PC65                 0.000000e+00                     22.4359425
## PC145                2.367954e+01                     22.3553864
## PC54                 4.050821e+00                     22.1353875
## PC24                 2.329016e+01                     21.9935040
## PC60                 1.935100e+01                     21.7842379
## PC158                0.000000e+00                     21.5721573
## PC14                 4.646959e+01                     21.5576443
## PC25                 0.000000e+00                     21.5276110
## PC164                1.321090e-01                     21.3710389
## PC177                4.053201e+00                     21.3510636
## PC41                 0.000000e+00                     21.2769869
## PC127                0.000000e+00                     20.9398104
## PC148                1.685374e+01                     20.6352870
## PC11                 3.376872e+01                     19.9626104
## PC83                 3.881538e+01                     19.7384404
## PC63                 6.468828e+00                     19.7138926
## PC44                 4.445818e+01                     19.0624764
## PC147                3.586515e+01                     19.0063835
## PC10                 3.822141e+01                     18.8904392
## PC135                2.697665e+01                     18.4779731
## PC126                0.000000e+00                     18.3783143
## PC156                2.446547e+01                     18.2906884
## PC153                3.481962e+01                     18.1008475
## PC101                1.176511e+00                     17.8342326
## PC168                3.922960e+01                     17.4547735
## PC38                 1.838838e+01                     17.0532725
## PC163                5.034326e+01                     16.9912818
## PC137                3.728419e+01                     16.9504693
## PC32                 0.000000e+00                     15.5824392
## PC73                 5.291358e+01                     15.5662427
## PC74                 3.832925e+01                     15.3029459
## PC51                 0.000000e+00                     14.7363183
## PC144                7.010065e+01                     14.2694009
## PC162                3.612958e+00                     14.0926054
## PC52                 1.524829e+01                     14.0037485
## PC75                 2.638460e+01                     13.8468267
## PC141                1.112507e+01                     13.8388427
## PC171                2.531038e+01                     13.3782616
## PC86                 2.485278e+01                     13.3447711
## PC67                 0.000000e+00                     12.7995887
## PC161                1.062154e+01                     12.5917028
## PC62                 0.000000e+00                     12.5560176
## PC33                 6.838701e+01                     12.2452460
## PC4                  2.088729e+01                     11.8561818
## PC150                0.000000e+00                     11.7760464
## PC110                6.055558e+01                     11.6801702
## PC95                 9.695666e+00                     11.3193024
## PC58                 2.727390e+01                     11.1143952
## PC23                 6.975107e+00                     11.0415398
## PC68                 0.000000e+00                     10.6593573
## PC96                 0.000000e+00                     10.6186471
## PC104                0.000000e+00                     10.5997138
## PC34                 2.985494e+01                      9.9111577
## PC155                3.706870e+01                      9.2180488
## PC88                 1.815422e+00                      9.2054702
## PC128                6.982828e+01                      8.5027014
## PC40                 0.000000e+00                      8.3594245
## PC129                0.000000e+00                      8.2875922
## PC56                 0.000000e+00                      7.7265443
## PC172                5.303319e-01                      7.5684732
## PC82                 0.000000e+00                      7.1583681
## PC99                 1.130747e+01                      6.9211866
## PC35                 7.315796e+01                      6.8479330
## PC175                0.000000e+00                      6.4314132
## PC105                0.000000e+00                      5.8433261
## PC2                  8.646527e+00                      5.7120059
## PC91                 3.343727e+01                      5.6951291
## PC89                 3.230346e+01                      5.6774383
## PC108                0.000000e+00                      5.1048663
## PC157                0.000000e+00                      5.0260847
## PC160                0.000000e+00                      4.9223355
## PC122                4.042866e+01                      4.7070287
## PC19                 5.092883e+00                      4.4921748
## PC71                 0.000000e+00                      4.2551143
## PC97                 2.642836e+00                      4.1083654
## PC13                 3.070796e+01                      3.9714677
## PC102                6.930198e+00                      3.9705179
## PC5                  0.000000e+00                      3.9557153
## PC37                 7.602710e+00                      3.6783449
## PC174                4.419996e+01                      3.6349766
## PC1                  4.431252e+00                      3.1855163
## PC114                1.271674e+00                      2.9250423
## PC29                 5.254738e+01                      2.8597341
## PC57                 1.296634e+01                      2.5770127
## PC138                4.559336e+01                      2.5712020
## PC133                0.000000e+00                      2.4537673
## PC3                  3.679924e+00                      2.2430573
## PC30                 1.897980e+01                      2.1469129
## PC42                 0.000000e+00                      2.0567734
## PC39                 0.000000e+00                      1.7709973
## PC119                5.347449e+00                      1.3244086
## PC100                4.532840e+00                      1.2842843
## PC72                 0.000000e+00                      0.9524748
## PC109                2.867807e+00                      0.8477182
## PC178                9.244490e+00                      0.6405221
## PC173                0.000000e+00                      0.4007699
## PC124                3.662386e+01                      0.2418955
## PC118                0.000000e+00                      0.1511340
## PC103                0.000000e+00                      0.0000000
## PC106                4.872059e+01                      0.0000000
## PC107                9.153527e-01                      0.0000000
## PC111                6.230038e+01                      0.0000000
## PC112                1.338934e+01                      0.0000000
## PC115                4.921876e+01                      0.0000000
## PC117                1.613769e+01                      0.0000000
## PC123                5.724446e+01                      0.0000000
## PC131                2.388039e+01                      0.0000000
## PC146                2.488196e+01                      0.0000000
## PC149                0.000000e+00                      0.0000000
## PC15                 3.401918e+01                      0.0000000
## PC151                0.000000e+00                      0.0000000
## PC154                2.783634e+01                      0.0000000
## PC159                2.441279e+01                      0.0000000
## PC165                5.257870e+01                      0.0000000
## PC167                1.633314e+01                      0.0000000
## PC169                4.175077e+01                      0.0000000
## PC179                0.000000e+00                      0.0000000
## PC180                2.996555e+01                      0.0000000
## PC181                          NA                      0.0000000
## PC22                 0.000000e+00                      0.0000000
## PC43                 0.000000e+00                      0.0000000
## PC45                 3.501084e+01                      0.0000000
## PC49                 8.930977e+00                      0.0000000
## PC53                 3.961769e+01                      0.0000000
## PC55                 3.366349e+01                      0.0000000
## PC59                 1.263362e+01                      0.0000000
## PC61                 0.000000e+00                      0.0000000
## PC64                 1.202000e+01                      0.0000000
## PC69                 1.487455e+01                      0.0000000
## PC70                 3.815807e+01                      0.0000000
## PC76                 0.000000e+00                      0.0000000
## PC80                 0.000000e+00                      0.0000000
## PC81                 0.000000e+00                      0.0000000
## PC84                 1.476555e+00                      0.0000000
## PC87                 3.885272e+01                      0.0000000
## PC90                 2.319657e+01                      0.0000000
## PC93                 0.000000e+00                      0.0000000
## PC94                 2.450185e+01                      0.0000000
## PC98                 1.638492e+01                      0.0000000
##               imp
## PC130 100.0000000
## PC28   70.8946101
## PC21   67.6291473
## PC134  62.6873757
## PC116  59.7109782
## PC120  55.3358766
## PC36   53.5826145
## PC125  53.0630014
## PC26   51.5920368
## PC166  49.9400943
## PC139  49.1075520
## PC170  47.0773911
## PC143  46.7640067
## PC18   45.5370482
## PC12   45.1817693
## PC92   44.4511794
## PC79   40.5758428
## PC132  40.2056225
## PC176  39.7504818
## PC27   38.8512853
## PC17   37.6340316
## PC31   37.3390487
## PC20   37.2581878
## PC136  36.7426511
## PC85   34.9031946
## PC6    31.7449693
## PC182  31.2291154
## PC66   31.2076021
## PC8    30.9117104
## PC77   29.7193577
## PC113  28.1272489
## PC140  28.0927410
## PC16   27.7333355
## PC121  27.7185609
## PC46   27.1077584
## PC142  27.1053068
## PC50   27.0272641
## PC7    25.6944700
## PC152  24.4339200
## PC9    23.9140094
## PC48   23.4502639
## PC78   22.6176140
## PC47   22.5319977
## PC65   22.4359425
## PC145  22.3553864
## PC54   22.1353875
## PC24   21.9935040
## PC60   21.7842379
## PC158  21.5721573
## PC14   21.5576443
## PC25   21.5276110
## PC164  21.3710389
## PC177  21.3510636
## PC41   21.2769869
## PC127  20.9398104
## PC148  20.6352870
## PC11   19.9626104
## PC83   19.7384404
## PC63   19.7138926
## PC44   19.0624764
## PC147  19.0063835
## PC10   18.8904392
## PC135  18.4779731
## PC126  18.3783143
## PC156  18.2906884
## PC153  18.1008475
## PC101  17.8342326
## PC168  17.4547735
## PC38   17.0532725
## PC163  16.9912818
## PC137  16.9504693
## PC32   15.5824392
## PC73   15.5662427
## PC74   15.3029459
## PC51   14.7363183
## PC144  14.2694009
## PC162  14.0926054
## PC52   14.0037485
## PC75   13.8468267
## PC141  13.8388427
## PC171  13.3782616
## PC86   13.3447711
## PC67   12.7995887
## PC161  12.5917028
## PC62   12.5560176
## PC33   12.2452460
## PC4    11.8561818
## PC150  11.7760464
## PC110  11.6801702
## PC95   11.3193024
## PC58   11.1143952
## PC23   11.0415398
## PC68   10.6593573
## PC96   10.6186471
## PC104  10.5997138
## PC34    9.9111577
## PC155   9.2180488
## PC88    9.2054702
## PC128   8.5027014
## PC40    8.3594245
## PC129   8.2875922
## PC56    7.7265443
## PC172   7.5684732
## PC82    7.1583681
## PC99    6.9211866
## PC35    6.8479330
## PC175   6.4314132
## PC105   5.8433261
## PC2     5.7120059
## PC91    5.6951291
## PC89    5.6774383
## PC108   5.1048663
## PC157   5.0260847
## PC160   4.9223355
## PC122   4.7070287
## PC19    4.4921748
## PC71    4.2551143
## PC97    4.1083654
## PC13    3.9714677
## PC102   3.9705179
## PC5     3.9557153
## PC37    3.6783449
## PC174   3.6349766
## PC1     3.1855163
## PC114   2.9250423
## PC29    2.8597341
## PC57    2.5770127
## PC138   2.5712020
## PC133   2.4537673
## PC3     2.2430573
## PC30    2.1469129
## PC42    2.0567734
## PC39    1.7709973
## PC119   1.3244086
## PC100   1.2842843
## PC72    0.9524748
## PC109   0.8477182
## PC178   0.6405221
## PC173   0.4007699
## PC124   0.2418955
## PC118   0.1511340
## PC103   0.0000000
## PC106   0.0000000
## PC107   0.0000000
## PC111   0.0000000
## PC112   0.0000000
## PC115   0.0000000
## PC117   0.0000000
## PC123   0.0000000
## PC131   0.0000000
## PC146   0.0000000
## PC149   0.0000000
## PC15    0.0000000
## PC151   0.0000000
## PC154   0.0000000
## PC159   0.0000000
## PC165   0.0000000
## PC167   0.0000000
## PC169   0.0000000
## PC179   0.0000000
## PC180   0.0000000
## PC181   0.0000000
## PC22    0.0000000
## PC43    0.0000000
## PC45    0.0000000
## PC49    0.0000000
## PC53    0.0000000
## PC55    0.0000000
## PC59    0.0000000
## PC61    0.0000000
## PC64    0.0000000
## PC69    0.0000000
## PC70    0.0000000
## PC76    0.0000000
## PC80    0.0000000
## PC81    0.0000000
## PC84    0.0000000
## PC87    0.0000000
## PC90    0.0000000
## PC93    0.0000000
## PC94    0.0000000
## PC98    0.0000000
if (glb_is_classification && glb_is_binomial)
    glb_analytics_diag_plots(obs_df=glbObsTrn, mdl_id=glbMdlFinId, 
            prob_threshold=glb_models_df[glb_models_df$id == glbMdlSelId, 
                                         "opt.prob.threshold.OOB"]) else
    glb_analytics_diag_plots(obs_df=glbObsTrn, mdl_id=glbMdlFinId)                  
## Warning in glb_analytics_diag_plots(obs_df = glbObsTrn, mdl_id =
## glbMdlFinId, : Limiting important feature scatter plots to 5 out of 182

## [1] "Min/Max Boundaries: "
##   USER_ID Party.fctr Party.fctr.All.X.zv.pca.rcv.glmnet
## 1    4474          R                                  D
## 2    2508          R                                  D
## 3    2485          R                                  R
## 4    3080          R                                  R
##   Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 1                               0.2636662
## 2                               0.4020824
## 3                               0.6714298
## 4                               0.7771728
##   Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                      TRUE
## 4                                      TRUE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                  FALSE
## 4                                  FALSE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs
## 1                                  0.7363338
## 2                                  0.5979176
## 3                                  0.3285702
## 4                                  0.2228272
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet
## 1                                             R
## 2                                             R
## 3                                             R
## 4                                             R
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## 1                                          0.4914286
## 2                                          0.5222597
## 3                                          0.5684511
## 4                                          0.5394151
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.is.acc
## 1                                                 TRUE
## 2                                                 TRUE
## 3                                                 TRUE
## 4                                                 TRUE
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err
## 1                                             FALSE
## 2                                             FALSE
## 3                                             FALSE
## 4                                             FALSE
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err.abs
## 1                                             0.5085714
## 2                                             0.4777403
## 3                                             0.4315489
## 4                                             0.4605849
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      R
## 3                                      R
## 4                                      R
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 1                                   0.3504438
## 2                                   0.4521924
## 3                                   0.4911294
## 4                                   0.4685787
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                          TRUE
## 3                                          TRUE
## 4                                          TRUE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                      FALSE
## 3                                      FALSE
## 4                                      FALSE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.6495562
## 2                                      0.5478076
## 3                                      0.5088706
## 4                                      0.5314213
##   Party.fctr.All.X.expoTrans.rcv.glmnet
## 1                                     D
## 2                                     R
## 3                                     R
## 4                                     R
##   Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 1                                  0.3503157
## 2                                  0.4523322
## 3                                  0.4910870
## 4                                  0.4686887
##   Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 1                                      TRUE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.6496843
## 2                                     0.5476678
## 3                                     0.5089130
## 4                                     0.5313113
##   Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 1                            D                         0.3508010
## 2                            R                         0.4519327
## 3                            R                         0.4916039
## 4                            R                         0.4684441
##   Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 1                               FALSE                             TRUE
## 2                                TRUE                            FALSE
## 3                                TRUE                            FALSE
## 4                                TRUE                            FALSE
##   Party.fctr.All.X..rcv.glmnet.err.abs
## 1                            0.6491990
## 2                            0.5480673
## 3                            0.5083961
## 4                            0.5315559
##   Party.fctr.All.X.conditionalX.rcv.glmnet
## 1                                        D
## 2                                        R
## 3                                        R
## 4                                        R
##   Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 1                                     0.3508010
## 2                                     0.4519327
## 3                                     0.4916039
## 4                                     0.4684441
##   Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                            TRUE
## 3                                            TRUE
## 4                                            TRUE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 1                                         TRUE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.6491990
## 2                                        0.5480673
## 3                                        0.5083961
## 4                                        0.5315559
##   Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 1                              D                           0.3508010
## 2                              R                           0.4519327
## 3                              R                           0.4916039
## 4                              R                           0.4684441
##   Party.fctr.All.X.zv.rcv.glmnet.is.acc Party.fctr.All.X.zv.rcv.glmnet.err
## 1                                 FALSE                               TRUE
## 2                                  TRUE                              FALSE
## 3                                  TRUE                              FALSE
## 4                                  TRUE                              FALSE
##   Party.fctr.All.X.zv.rcv.glmnet.err.abs
## 1                              0.6491990
## 2                              0.5480673
## 3                              0.5083961
## 4                              0.5315559
##   Party.fctr.All.X.center.rcv.glmnet
## 1                                  D
## 2                                  R
## 3                                  R
## 4                                  R
##   Party.fctr.All.X.center.rcv.glmnet.prob
## 1                               0.3508010
## 2                               0.4519327
## 3                               0.4916039
## 4                               0.4684441
##   Party.fctr.All.X.center.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
##   Party.fctr.All.X.center.rcv.glmnet.err
## 1                                   TRUE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
##   Party.fctr.All.X.center.rcv.glmnet.err.abs
## 1                                  0.6491990
## 2                                  0.5480673
## 3                                  0.5083961
## 4                                  0.5315559
##   Party.fctr.All.X.scale.rcv.glmnet Party.fctr.All.X.scale.rcv.glmnet.prob
## 1                                 D                              0.3508010
## 2                                 R                              0.4519327
## 3                                 R                              0.4916039
## 4                                 R                              0.4684441
##   Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                     TRUE
## 3                                     TRUE
## 4                                     TRUE
##   Party.fctr.All.X.scale.rcv.glmnet.err
## 1                                  TRUE
## 2                                 FALSE
## 3                                 FALSE
## 4                                 FALSE
##   Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 1                                 0.6491990
## 2                                 0.5480673
## 3                                 0.5083961
## 4                                 0.5315559
##   Party.fctr.All.X.center.scale.rcv.glmnet
## 1                                        D
## 2                                        R
## 3                                        R
## 4                                        R
##   Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 1                                     0.3508010
## 2                                     0.4519327
## 3                                     0.4916039
## 4                                     0.4684441
##   Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                            TRUE
## 3                                            TRUE
## 4                                            TRUE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err
## 1                                         TRUE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.6491990
## 2                                        0.5480673
## 3                                        0.5083961
## 4                                        0.5315559
##   Party.fctr.All.X.BoxCox.rcv.glmnet
## 1                                  D
## 2                                  R
## 3                                  R
## 4                                  R
##   Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 1                               0.3508010
## 2                               0.4519327
## 3                               0.4916039
## 4                               0.4684441
##   Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 1                                   TRUE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.6491990
## 2                                  0.5480673
## 3                                  0.5083961
## 4                                  0.5315559
##   Party.fctr.All.X.range.rcv.glmnet Party.fctr.All.X.range.rcv.glmnet.prob
## 1                                 D                              0.3508010
## 2                                 R                              0.4519327
## 3                                 R                              0.4916039
## 4                                 R                              0.4684441
##   Party.fctr.All.X.range.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                     TRUE
## 3                                     TRUE
## 4                                     TRUE
##   Party.fctr.All.X.range.rcv.glmnet.err
## 1                                  TRUE
## 2                                 FALSE
## 3                                 FALSE
## 4                                 FALSE
##   Party.fctr.All.X.range.rcv.glmnet.err.abs Party.fctr.All.X..rcv.gbm
## 1                                 0.6491990                         D
## 2                                 0.5480673                         R
## 3                                 0.5083961                         R
## 4                                 0.5315559                         R
##   Party.fctr.All.X..rcv.gbm.prob Party.fctr.All.X..rcv.gbm.is.acc
## 1                      0.4036735                            FALSE
## 2                      0.6144276                             TRUE
## 3                      0.5971240                             TRUE
## 4                      0.5404456                             TRUE
##   Party.fctr.All.X..rcv.gbm.err Party.fctr.All.X..rcv.gbm.err.abs
## 1                          TRUE                         0.5963265
## 2                         FALSE                         0.3855724
## 3                         FALSE                         0.4028760
## 4                         FALSE                         0.4595544
##   Party.fctr.All.X..rcv.nnet Party.fctr.All.X..rcv.nnet.prob
## 1                          D                       0.1444532
## 2                          R                       0.7774393
## 3                          R                       0.7742537
## 4                          R                       0.7833386
##   Party.fctr.All.X..rcv.nnet.is.acc Party.fctr.All.X..rcv.nnet.err
## 1                             FALSE                           TRUE
## 2                              TRUE                          FALSE
## 3                              TRUE                          FALSE
## 4                              TRUE                          FALSE
##   Party.fctr.All.X..rcv.nnet.err.abs Party.fctr.All.X..rcv.earth
## 1                          0.8555468                           D
## 2                          0.2225607                           D
## 3                          0.2257463                           D
## 4                          0.2166614                           D
##   Party.fctr.All.X..rcv.earth.prob Party.fctr.All.X..rcv.earth.is.acc
## 1                        0.2844272                              FALSE
## 2                        0.4367259                              FALSE
## 3                        0.5045073                              FALSE
## 4                        0.3858837                              FALSE
##   Party.fctr.All.X..rcv.earth.err Party.fctr.All.X..rcv.earth.err.abs
## 1                            TRUE                           0.7155728
## 2                            TRUE                           0.5632741
## 3                            TRUE                           0.4954927
## 4                            TRUE                           0.6141163
##   Party.fctr.All.X..rcv.bayesglm Party.fctr.All.X..rcv.bayesglm.prob
## 1                              D                           0.1336882
## 2                              R                           0.5302837
## 3                              R                           0.7955017
## 4                              D                           0.3591314
##   Party.fctr.All.X..rcv.bayesglm.is.acc Party.fctr.All.X..rcv.bayesglm.err
## 1                                 FALSE                               TRUE
## 2                                  TRUE                              FALSE
## 3                                  TRUE                              FALSE
## 4                                 FALSE                               TRUE
##   Party.fctr.All.X..rcv.bayesglm.err.abs Party.fctr.All.X..rcv.glm
## 1                              0.8663118                         D
## 2                              0.4697163                         R
## 3                              0.2044983                         R
## 4                              0.6408686                         D
##   Party.fctr.All.X..rcv.glm.prob Party.fctr.All.X..rcv.glm.is.acc
## 1                      0.1295611                            FALSE
## 2                      0.5256251                             TRUE
## 3                      0.7946513                             TRUE
## 4                      0.3383020                            FALSE
##   Party.fctr.All.X..rcv.glm.err Party.fctr.All.X..rcv.glm.err.abs
## 1                          TRUE                         0.8704389
## 2                         FALSE                         0.4743749
## 3                         FALSE                         0.2053487
## 4                          TRUE                         0.6616980
##   Party.fctr.All.X..rcv.bagEarth Party.fctr.All.X..rcv.bagEarth.prob
## 1                              D                           0.2233373
## 2                              R                           0.5934772
## 3                              R                           0.7626567
## 4                              R                           0.5794115
##   Party.fctr.All.X..rcv.bagEarth.is.acc Party.fctr.All.X..rcv.bagEarth.err
## 1                                 FALSE                               TRUE
## 2                                  TRUE                              FALSE
## 3                                  TRUE                              FALSE
## 4                                  TRUE                              FALSE
##   Party.fctr.All.X..rcv.bagEarth.err.abs Party.fctr.All.X.nzv.rcv.glmnet
## 1                              0.7766627                               D
## 2                              0.4065228                               R
## 3                              0.2373433                               R
## 4                              0.4205885                               R
##   Party.fctr.All.X.nzv.rcv.glmnet.prob
## 1                            0.3429327
## 2                            0.4502793
## 3                            0.4875585
## 4                            0.4718322
##   Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
##   Party.fctr.All.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                               FALSE
## 3                               FALSE
## 4                               FALSE
##   Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.All.X..rcv.rf
## 1                               0.6570673                        R
## 2                               0.5497207                        R
## 3                               0.5124415                        R
## 4                               0.5281678                        D
##   Party.fctr.All.X..rcv.rf.prob Party.fctr.All.X..rcv.rf.is.acc
## 1                         0.838                            TRUE
## 2                         0.826                            TRUE
## 3                         0.802                            TRUE
## 4                         0.540                           FALSE
##   Party.fctr.All.X..rcv.rf.err Party.fctr.All.X..rcv.rf.err.abs
## 1                        FALSE                            0.162
## 2                        FALSE                            0.174
## 3                        FALSE                            0.198
## 4                         TRUE                            0.460
##   Party.fctr.All.X..rcv.avNNet Party.fctr.All.X..rcv.avNNet.prob
## 1                            D                         0.2467027
## 2                            D                         0.5242411
## 3                            R                         0.6516199
## 4                            D                         0.3651022
##   Party.fctr.All.X..rcv.avNNet.is.acc Party.fctr.All.X..rcv.avNNet.err
## 1                               FALSE                             TRUE
## 2                               FALSE                             TRUE
## 3                                TRUE                            FALSE
## 4                               FALSE                             TRUE
##   Party.fctr.All.X..rcv.avNNet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 1                            0.7532973                                D
## 2                            0.4757589                                D
## 3                            0.3483801                                R
## 4                            0.6348978                                R
##   Party.fctr.Low.cor.X..rcv.glmnet.prob
## 1                             0.3505759
## 2                             0.4309562
## 3                             0.4716044
## 4                             0.4503105
##   Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 1                                   FALSE
## 2                                   FALSE
## 3                                    TRUE
## 4                                    TRUE
##   Party.fctr.Low.cor.X..rcv.glmnet.err
## 1                                 TRUE
## 2                                 TRUE
## 3                                FALSE
## 4                                FALSE
##   Party.fctr.Low.cor.X..rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.glmnet
## 1                                0.6494241                            R
## 2                                0.5690438                            R
## 3                                0.5283956                            R
## 4                                0.5496895                            R
##   Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 1                         0.5258048                                TRUE
## 2                         0.4633499                                TRUE
## 3                         0.5527971                                TRUE
## 4                         0.4551633                                TRUE
##   Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 1                            FALSE                            0.4741952
## 2                            FALSE                            0.5366501
## 3                            FALSE                            0.4472029
## 4                            FALSE                            0.5448367
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 1                                          D
## 2                                          R
## 3                                          D
## 4                                          R
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 1                                       0.2241355
## 2                                       0.6367009
## 3                                       0.3743861
## 4                                       0.6627563
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 1                                             FALSE
## 2                                              TRUE
## 3                                             FALSE
## 4                                              TRUE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 1                                           TRUE
## 2                                          FALSE
## 3                                           TRUE
## 4                                          FALSE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 1                                          0.7758645
## 2                                          0.3632991
## 3                                          0.6256139
## 4                                          0.3372437
##   Party.fctr.All.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
## 3                                       D
## 4                                       D
##   Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 1                                    0.3680090
## 2                                    0.4130758
## 3                                    0.4503665
## 4                                    0.4153486
##   Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                          FALSE
## 3                                          FALSE
## 4                                          FALSE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                        TRUE
## 3                                        TRUE
## 4                                        TRUE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.6319910
## 2                                       0.5869242
## 3                                       0.5496335
## 4                                       0.5846514
##   Party.fctr.All.X..rcv.rpart Party.fctr.All.X..rcv.rpart.prob
## 1                           R                        0.6225490
## 2                           D                        0.3412322
## 3                           D                        0.2330827
## 4                           D                        0.3412322
##   Party.fctr.All.X..rcv.rpart.is.acc Party.fctr.All.X..rcv.rpart.err
## 1                               TRUE                           FALSE
## 2                              FALSE                            TRUE
## 3                              FALSE                            TRUE
## 4                              FALSE                            TRUE
##   Party.fctr.All.X..rcv.rpart.err.abs
## 1                           0.3774510
## 2                           0.6587678
## 3                           0.7669173
## 4                           0.6587678
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet
## 1                                     D
## 2                                     R
## 3                                     D
## 4                                     D
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## 1                                  0.2694411
## 2                                  0.5531271
## 3                                  0.2694411
## 4                                  0.5122987
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.is.acc
## 1                                        FALSE
## 2                                         TRUE
## 3                                        FALSE
## 4                                        FALSE
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err
## 1                                      TRUE
## 2                                     FALSE
## 3                                      TRUE
## 4                                      TRUE
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err.abs
## 1                                     0.7305589
## 2                                     0.4468729
## 3                                     0.7305589
## 4                                     0.4877013
##   Party.fctr.Max.cor.Y..rcv.rpart Party.fctr.Max.cor.Y..rcv.rpart.prob
## 1                               D                             0.300000
## 2                               R                             0.521265
## 3                               D                             0.300000
## 4                               R                             0.521265
##   Party.fctr.Max.cor.Y..rcv.rpart.is.acc
## 1                                  FALSE
## 2                                   TRUE
## 3                                  FALSE
## 4                                   TRUE
##   Party.fctr.Max.cor.Y..rcv.rpart.err
## 1                                TRUE
## 2                               FALSE
## 3                                TRUE
## 4                               FALSE
##   Party.fctr.Max.cor.Y..rcv.rpart.err.abs Party.fctr.All.X.ica.rcv.glmnet
## 1                                0.700000                               D
## 2                                0.478735                               D
## 3                                0.700000                               D
## 4                                0.478735                               D
##   Party.fctr.All.X.ica.rcv.glmnet.prob
## 1                            0.4510318
## 2                            0.4552659
## 3                            0.4438212
## 4                            0.4517449
##   Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
##   Party.fctr.All.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
##   Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 1                               0.5489682
## 2                               0.5447341
## 3                               0.5561788
## 4                               0.5482551
##   Party.fctr.Final.All.X.zv.pca..glmnet.prob
## 1                                  0.3060807
## 2                                  0.3784938
## 3                                  0.5944617
## 4                                  0.8247734
##   Party.fctr.Final.All.X.zv.pca..glmnet
## 1                                     D
## 2                                     D
## 3                                     R
## 4                                     R
##   Party.fctr.Final.All.X.zv.pca..glmnet.err
## 1                                      TRUE
## 2                                      TRUE
## 3                                     FALSE
## 4                                     FALSE
##   Party.fctr.Final.All.X.zv.pca..glmnet.err.abs
## 1                                     0.6939193
## 2                                     0.6215062
## 3                                     0.4055383
## 4                                     0.1752266
##   Party.fctr.Final.All.X.zv.pca..glmnet.is.acc
## 1                                        FALSE
## 2                                        FALSE
## 3                                         TRUE
## 4                                         TRUE
##   Party.fctr.Final.All.X.zv.pca..glmnet.accurate
## 1                                          FALSE
## 2                                          FALSE
## 3                                           TRUE
## 4                                           TRUE
##   Party.fctr.Final.All.X.zv.pca..glmnet.error .label
## 1                                 -0.14391927   4474
## 2                                 -0.07150625   2508
## 3                                  0.00000000   2485
## 4                                  0.00000000   3080
## [1] "Inaccurate: "
##   USER_ID Party.fctr Party.fctr.All.X.zv.pca.rcv.glmnet
## 1    1461          R                                  D
## 2    4660          R                                  D
## 3    5551          R                                  D
## 4    1264          R                                  D
## 5    3380          R                                  D
## 6    4813          R                                  D
##   Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 1                              0.11796328
## 2                              0.12748916
## 3                              0.09135088
## 4                              0.03778821
## 5                              0.16603948
## 6                              0.30632341
##   Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs
## 1                                  0.8820367
## 2                                  0.8725108
## 3                                  0.9086491
## 4                                  0.9622118
## 5                                  0.8339605
## 6                                  0.6936766
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet
## 1                                             D
## 2                                             D
## 3                                             D
## 4                                             D
## 5                                             D
## 6                                             D
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## 1                                          0.2311483
## 2                                          0.4117693
## 3                                          0.3945762
## 4                                          0.2243570
## 5                                          0.2857474
## 6                                          0.3951070
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.is.acc
## 1                                                FALSE
## 2                                                FALSE
## 3                                                FALSE
## 4                                                FALSE
## 5                                                FALSE
## 6                                                FALSE
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err
## 1                                              TRUE
## 2                                              TRUE
## 3                                              TRUE
## 4                                              TRUE
## 5                                              TRUE
## 6                                              TRUE
##   Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err.abs
## 1                                             0.7688517
## 2                                             0.5882307
## 3                                             0.6054238
## 4                                             0.7756430
## 5                                             0.7142526
## 6                                             0.6048930
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      D
## 3                                      D
## 4                                      D
## 5                                      D
## 6                                      D
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 1                                   0.2827234
## 2                                   0.3292006
## 3                                   0.3169681
## 4                                   0.2109323
## 5                                   0.3171511
## 6                                   0.3986335
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                         FALSE
## 3                                         FALSE
## 4                                         FALSE
## 5                                         FALSE
## 6                                         FALSE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                       TRUE
## 3                                       TRUE
## 4                                       TRUE
## 5                                       TRUE
## 6                                       TRUE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.7172766
## 2                                      0.6707994
## 3                                      0.6830319
## 4                                      0.7890677
## 5                                      0.6828489
## 6                                      0.6013665
##   Party.fctr.All.X.expoTrans.rcv.glmnet
## 1                                     D
## 2                                     D
## 3                                     D
## 4                                     D
## 5                                     D
## 6                                     D
##   Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 1                                  0.2827498
## 2                                  0.3292514
## 3                                  0.3169495
## 4                                  0.2109067
## 5                                  0.3172557
## 6                                  0.3985753
##   Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
## 5                                        FALSE
## 6                                        FALSE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
## 5                                      TRUE
## 6                                      TRUE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.7172502
## 2                                     0.6707486
## 3                                     0.6830505
## 4                                     0.7890933
## 5                                     0.6827443
## 6                                     0.6014247
##   Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 1                            D                         0.2834618
## 2                            D                         0.3300527
## 3                            D                         0.3168096
## 4                            D                         0.2112086
## 5                            D                         0.3169899
## 6                            D                         0.3990366
##   Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 1                               FALSE                             TRUE
## 2                               FALSE                             TRUE
## 3                               FALSE                             TRUE
## 4                               FALSE                             TRUE
## 5                               FALSE                             TRUE
## 6                               FALSE                             TRUE
##   Party.fctr.All.X..rcv.glmnet.err.abs
## 1                            0.7165382
## 2                            0.6699473
## 3                            0.6831904
## 4                            0.7887914
## 5                            0.6830101
## 6                            0.6009634
##   Party.fctr.All.X.conditionalX.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 1                                     0.2834618
## 2                                     0.3300527
## 3                                     0.3168096
## 4                                     0.2112086
## 5                                     0.3169899
## 6                                     0.3990366
##   Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.7165382
## 2                                        0.6699473
## 3                                        0.6831904
## 4                                        0.7887914
## 5                                        0.6830101
## 6                                        0.6009634
##   Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 1                              D                           0.2834618
## 2                              D                           0.3300527
## 3                              D                           0.3168096
## 4                              D                           0.2112086
## 5                              D                           0.3169899
## 6                              D                           0.3990366
##   Party.fctr.All.X.zv.rcv.glmnet.is.acc Party.fctr.All.X.zv.rcv.glmnet.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.All.X.zv.rcv.glmnet.err.abs
## 1                              0.7165382
## 2                              0.6699473
## 3                              0.6831904
## 4                              0.7887914
## 5                              0.6830101
## 6                              0.6009634
##   Party.fctr.All.X.center.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.All.X.center.rcv.glmnet.prob
## 1                               0.2834618
## 2                               0.3300527
## 3                               0.3168096
## 4                               0.2112086
## 5                               0.3169899
## 6                               0.3990366
##   Party.fctr.All.X.center.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.All.X.center.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.All.X.center.rcv.glmnet.err.abs
## 1                                  0.7165382
## 2                                  0.6699473
## 3                                  0.6831904
## 4                                  0.7887914
## 5                                  0.6830101
## 6                                  0.6009634
##   Party.fctr.All.X.scale.rcv.glmnet Party.fctr.All.X.scale.rcv.glmnet.prob
## 1                                 D                              0.2834618
## 2                                 D                              0.3300527
## 3                                 D                              0.3168096
## 4                                 D                              0.2112086
## 5                                 D                              0.3169899
## 6                                 D                              0.3990366
##   Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                    FALSE
## 6                                    FALSE
##   Party.fctr.All.X.scale.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                  TRUE
## 6                                  TRUE
##   Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 1                                 0.7165382
## 2                                 0.6699473
## 3                                 0.6831904
## 4                                 0.7887914
## 5                                 0.6830101
## 6                                 0.6009634
##   Party.fctr.All.X.center.scale.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 1                                     0.2834618
## 2                                     0.3300527
## 3                                     0.3168096
## 4                                     0.2112086
## 5                                     0.3169899
## 6                                     0.3990366
##   Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.7165382
## 2                                        0.6699473
## 3                                        0.6831904
## 4                                        0.7887914
## 5                                        0.6830101
## 6                                        0.6009634
##   Party.fctr.All.X.BoxCox.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 1                               0.2834618
## 2                               0.3300527
## 3                               0.3168096
## 4                               0.2112086
## 5                               0.3169899
## 6                               0.3990366
##   Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.7165382
## 2                                  0.6699473
## 3                                  0.6831904
## 4                                  0.7887914
## 5                                  0.6830101
## 6                                  0.6009634
##   Party.fctr.All.X.range.rcv.glmnet Party.fctr.All.X.range.rcv.glmnet.prob
## 1                                 D                              0.2834618
## 2                                 D                              0.3300527
## 3                                 D                              0.3168096
## 4                                 D                              0.2112086
## 5                                 D                              0.3169899
## 6                                 D                              0.3990366
##   Party.fctr.All.X.range.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                    FALSE
## 6                                    FALSE
##   Party.fctr.All.X.range.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                  TRUE
## 6                                  TRUE
##   Party.fctr.All.X.range.rcv.glmnet.err.abs Party.fctr.All.X..rcv.gbm
## 1                                 0.7165382                         D
## 2                                 0.6699473                         D
## 3                                 0.6831904                         D
## 4                                 0.7887914                         D
## 5                                 0.6830101                         D
## 6                                 0.6009634                         D
##   Party.fctr.All.X..rcv.gbm.prob Party.fctr.All.X..rcv.gbm.is.acc
## 1                     0.19192465                            FALSE
## 2                     0.41698583                            FALSE
## 3                     0.32116476                            FALSE
## 4                     0.08076739                            FALSE
## 5                     0.28610530                            FALSE
## 6                     0.31398937                            FALSE
##   Party.fctr.All.X..rcv.gbm.err Party.fctr.All.X..rcv.gbm.err.abs
## 1                          TRUE                         0.8080753
## 2                          TRUE                         0.5830142
## 3                          TRUE                         0.6788352
## 4                          TRUE                         0.9192326
## 5                          TRUE                         0.7138947
## 6                          TRUE                         0.6860106
##   Party.fctr.All.X..rcv.nnet Party.fctr.All.X..rcv.nnet.prob
## 1                          D                       0.1444532
## 2                          D                       0.1444532
## 3                          D                       0.1444532
## 4                          D                       0.1444532
## 5                          D                       0.1444532
## 6                          D                       0.1444532
##   Party.fctr.All.X..rcv.nnet.is.acc Party.fctr.All.X..rcv.nnet.err
## 1                             FALSE                           TRUE
## 2                             FALSE                           TRUE
## 3                             FALSE                           TRUE
## 4                             FALSE                           TRUE
## 5                             FALSE                           TRUE
## 6                             FALSE                           TRUE
##   Party.fctr.All.X..rcv.nnet.err.abs Party.fctr.All.X..rcv.earth
## 1                          0.8555468                           D
## 2                          0.8555468                           D
## 3                          0.8555468                           D
## 4                          0.8555468                           D
## 5                          0.8555468                           D
## 6                          0.8555468                           D
##   Party.fctr.All.X..rcv.earth.prob Party.fctr.All.X..rcv.earth.is.acc
## 1                       0.25033993                              FALSE
## 2                       0.16884709                              FALSE
## 3                       0.20174389                              FALSE
## 4                       0.04308791                              FALSE
## 5                       0.20503928                              FALSE
## 6                       0.39475833                              FALSE
##   Party.fctr.All.X..rcv.earth.err Party.fctr.All.X..rcv.earth.err.abs
## 1                            TRUE                           0.7496601
## 2                            TRUE                           0.8311529
## 3                            TRUE                           0.7982561
## 4                            TRUE                           0.9569121
## 5                            TRUE                           0.7949607
## 6                            TRUE                           0.6052417
##   Party.fctr.All.X..rcv.bayesglm Party.fctr.All.X..rcv.bayesglm.prob
## 1                              D                          0.01920540
## 2                              D                          0.02000910
## 3                              D                          0.11283014
## 4                              D                          0.00161350
## 5                              D                          0.09938011
## 6                              D                          0.26380084
##   Party.fctr.All.X..rcv.bayesglm.is.acc Party.fctr.All.X..rcv.bayesglm.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.All.X..rcv.bayesglm.err.abs Party.fctr.All.X..rcv.glm
## 1                              0.9807946                         D
## 2                              0.9799909                         D
## 3                              0.8871699                         D
## 4                              0.9983865                         D
## 5                              0.9006199                         D
## 6                              0.7361992                         D
##   Party.fctr.All.X..rcv.glm.prob Party.fctr.All.X..rcv.glm.is.acc
## 1                    0.011804208                            FALSE
## 2                    0.017602457                            FALSE
## 3                    0.120404078                            FALSE
## 4                    0.001271532                            FALSE
## 5                    0.098717268                            FALSE
## 6                    0.260042867                            FALSE
##   Party.fctr.All.X..rcv.glm.err Party.fctr.All.X..rcv.glm.err.abs
## 1                          TRUE                         0.9881958
## 2                          TRUE                         0.9823975
## 3                          TRUE                         0.8795959
## 4                          TRUE                         0.9987285
## 5                          TRUE                         0.9012827
## 6                          TRUE                         0.7399571
##   Party.fctr.All.X..rcv.bagEarth Party.fctr.All.X..rcv.bagEarth.prob
## 1                              D                          0.11387685
## 2                              D                          0.09763399
## 3                              D                          0.19159947
## 4                              D                          0.02797337
## 5                              D                          0.28426098
## 6                              D                          0.33205087
##   Party.fctr.All.X..rcv.bagEarth.is.acc Party.fctr.All.X..rcv.bagEarth.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.All.X..rcv.bagEarth.err.abs Party.fctr.All.X.nzv.rcv.glmnet
## 1                              0.8861231                               D
## 2                              0.9023660                               D
## 3                              0.8084005                               D
## 4                              0.9720266                               D
## 5                              0.7157390                               D
## 6                              0.6679491                               D
##   Party.fctr.All.X.nzv.rcv.glmnet.prob
## 1                            0.3065293
## 2                            0.3244694
## 3                            0.3096822
## 4                            0.2244944
## 5                            0.3133470
## 6                            0.3948380
##   Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.All.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.All.X..rcv.rf
## 1                               0.6934707                        R
## 2                               0.6755306                        R
## 3                               0.6903178                        R
## 4                               0.7755056                        D
## 5                               0.6866530                        R
## 6                               0.6051620                        R
##   Party.fctr.All.X..rcv.rf.prob Party.fctr.All.X..rcv.rf.is.acc
## 1                         0.730                            TRUE
## 2                         0.750                            TRUE
## 3                         0.772                            TRUE
## 4                         0.336                           FALSE
## 5                         0.778                            TRUE
## 6                         0.752                            TRUE
##   Party.fctr.All.X..rcv.rf.err Party.fctr.All.X..rcv.rf.err.abs
## 1                        FALSE                            0.270
## 2                        FALSE                            0.250
## 3                        FALSE                            0.228
## 4                         TRUE                            0.664
## 5                        FALSE                            0.222
## 6                        FALSE                            0.248
##   Party.fctr.All.X..rcv.avNNet Party.fctr.All.X..rcv.avNNet.prob
## 1                            D                        0.36365577
## 2                            D                        0.24670315
## 3                            D                        0.24229297
## 4                            D                        0.08222648
## 5                            D                        0.04029538
## 6                            D                        0.49026851
##   Party.fctr.All.X..rcv.avNNet.is.acc Party.fctr.All.X..rcv.avNNet.err
## 1                               FALSE                             TRUE
## 2                               FALSE                             TRUE
## 3                               FALSE                             TRUE
## 4                               FALSE                             TRUE
## 5                               FALSE                             TRUE
## 6                               FALSE                             TRUE
##   Party.fctr.All.X..rcv.avNNet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 1                            0.6363442                                D
## 2                            0.7532968                                D
## 3                            0.7577070                                D
## 4                            0.9177735                                D
## 5                            0.9597046                                D
## 6                            0.5097315                                D
##   Party.fctr.Low.cor.X..rcv.glmnet.prob
## 1                             0.2845409
## 2                             0.3539511
## 3                             0.3192201
## 4                             0.2260633
## 5                             0.3034916
## 6                             0.4056257
##   Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 1                                   FALSE
## 2                                   FALSE
## 3                                   FALSE
## 4                                   FALSE
## 5                                   FALSE
## 6                                   FALSE
##   Party.fctr.Low.cor.X..rcv.glmnet.err
## 1                                 TRUE
## 2                                 TRUE
## 3                                 TRUE
## 4                                 TRUE
## 5                                 TRUE
## 6                                 TRUE
##   Party.fctr.Low.cor.X..rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.glmnet
## 1                                0.7154591                            D
## 2                                0.6460489                            R
## 3                                0.6807799                            D
## 4                                0.7739367                            D
## 5                                0.6965084                            D
## 6                                0.5943743                            D
##   Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 1                         0.3020488                               FALSE
## 2                         0.4959599                                TRUE
## 3                         0.4203792                               FALSE
## 4                         0.2761808                               FALSE
## 5                         0.3005347                               FALSE
## 6                         0.2686179                               FALSE
##   Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 1                             TRUE                            0.6979512
## 2                            FALSE                            0.5040401
## 3                             TRUE                            0.5796208
## 4                             TRUE                            0.7238192
## 5                             TRUE                            0.6994653
## 6                             TRUE                            0.7313821
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 1                                          D
## 2                                          D
## 3                                          D
## 4                                          D
## 5                                          R
## 6                                          D
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 1                                       0.2309237
## 2                                       0.1689843
## 3                                       0.3063474
## 4                                       0.1562647
## 5                                       0.5866924
## 6                                       0.4026004
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 1                                             FALSE
## 2                                             FALSE
## 3                                             FALSE
## 4                                             FALSE
## 5                                              TRUE
## 6                                             FALSE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 1                                           TRUE
## 2                                           TRUE
## 3                                           TRUE
## 4                                           TRUE
## 5                                          FALSE
## 6                                           TRUE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 1                                          0.7690763
## 2                                          0.8310157
## 3                                          0.6936526
## 4                                          0.8437353
## 5                                          0.4133076
## 6                                          0.5973996
##   Party.fctr.All.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
## 3                                       D
## 4                                       D
## 5                                       D
## 6                                       D
##   Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 1                                    0.3459378
## 2                                    0.4010354
## 3                                    0.3347352
## 4                                    0.3087263
## 5                                    0.3392487
## 6                                    0.4262778
##   Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                          FALSE
## 3                                          FALSE
## 4                                          FALSE
## 5                                          FALSE
## 6                                          FALSE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                        TRUE
## 3                                        TRUE
## 4                                        TRUE
## 5                                        TRUE
## 6                                        TRUE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.6540622
## 2                                       0.5989646
## 3                                       0.6652648
## 4                                       0.6912737
## 5                                       0.6607513
## 6                                       0.5737222
##   Party.fctr.All.X..rcv.rpart Party.fctr.All.X..rcv.rpart.prob
## 1                           D                        0.2330827
## 2                           D                        0.2330827
## 3                           D                        0.2330827
## 4                           D                        0.2330827
## 5                           D                        0.3412322
## 6                           D                        0.3412322
##   Party.fctr.All.X..rcv.rpart.is.acc Party.fctr.All.X..rcv.rpart.err
## 1                              FALSE                            TRUE
## 2                              FALSE                            TRUE
## 3                              FALSE                            TRUE
## 4                              FALSE                            TRUE
## 5                              FALSE                            TRUE
## 6                              FALSE                            TRUE
##   Party.fctr.All.X..rcv.rpart.err.abs
## 1                           0.7669173
## 2                           0.7669173
## 3                           0.7669173
## 4                           0.7669173
## 5                           0.6587678
## 6                           0.6587678
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet
## 1                                     D
## 2                                     D
## 3                                     D
## 4                                     D
## 5                                     D
## 6                                     D
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## 1                                  0.2694411
## 2                                  0.2694411
## 3                                  0.3479286
## 4                                  0.2694411
## 5                                  0.4610815
## 6                                  0.4206517
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.is.acc
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
## 5                                        FALSE
## 6                                        FALSE
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
## 5                                      TRUE
## 6                                      TRUE
##   Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err.abs
## 1                                     0.7305589
## 2                                     0.7305589
## 3                                     0.6520714
## 4                                     0.7305589
## 5                                     0.5389185
## 6                                     0.5793483
##   Party.fctr.Max.cor.Y..rcv.rpart Party.fctr.Max.cor.Y..rcv.rpart.prob
## 1                               D                            0.3000000
## 2                               D                            0.3000000
## 3                               D                            0.3000000
## 4                               D                            0.3000000
## 5                               D                            0.4231928
## 6                               D                            0.4231928
##   Party.fctr.Max.cor.Y..rcv.rpart.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.Max.cor.Y..rcv.rpart.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.Max.cor.Y..rcv.rpart.err.abs Party.fctr.All.X.ica.rcv.glmnet
## 1                               0.7000000                               D
## 2                               0.7000000                               D
## 3                               0.7000000                               D
## 4                               0.7000000                               D
## 5                               0.5768072                               D
## 6                               0.5768072                               D
##   Party.fctr.All.X.ica.rcv.glmnet.prob
## 1                            0.4548490
## 2                            0.4427013
## 3                            0.4311697
## 4                            0.4533077
## 5                            0.4433036
## 6                            0.4973842
##   Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.All.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 1                               0.5451510
## 2                               0.5572987
## 3                               0.5688303
## 4                               0.5466923
## 5                               0.5566964
## 6                               0.5026158
##   Party.fctr.Final.All.X.zv.pca..glmnet.prob
## 1                                 0.08690793
## 2                                 0.11737755
## 3                                 0.12472114
## 4                                 0.13012264
## 5                                 0.14371284
## 6                                 0.19321859
##   Party.fctr.Final.All.X.zv.pca..glmnet
## 1                                     D
## 2                                     D
## 3                                     D
## 4                                     D
## 5                                     D
## 6                                     D
##   Party.fctr.Final.All.X.zv.pca..glmnet.err
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
## 5                                      TRUE
## 6                                      TRUE
##   Party.fctr.Final.All.X.zv.pca..glmnet.err.abs
## 1                                     0.9130921
## 2                                     0.8826224
## 3                                     0.8752789
## 4                                     0.8698774
## 5                                     0.8562872
## 6                                     0.8067814
##   Party.fctr.Final.All.X.zv.pca..glmnet.is.acc
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
## 5                                        FALSE
## 6                                        FALSE
##   Party.fctr.Final.All.X.zv.pca..glmnet.accurate
## 1                                          FALSE
## 2                                          FALSE
## 3                                          FALSE
## 4                                          FALSE
## 5                                          FALSE
## 6                                          FALSE
##   Party.fctr.Final.All.X.zv.pca..glmnet.error
## 1                                  -0.3630921
## 2                                  -0.3326224
## 3                                  -0.3252789
## 4                                  -0.3198774
## 5                                  -0.3062872
## 6                                  -0.2567814
##     USER_ID Party.fctr Party.fctr.All.X.zv.pca.rcv.glmnet
## 70      746          R                                  D
## 426    2401          D                                  R
## 500    3636          D                                  R
## 562    6109          D                                  R
## 600    6670          D                                  R
## 729    2495          D                                  R
##     Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 70                                0.2544340
## 426                               0.5175626
## 500                               0.6283889
## 562                               0.5210199
## 600                               0.5938542
## 729                               0.8651290
##     Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 70                                      FALSE
## 426                                     FALSE
## 500                                     FALSE
## 562                                     FALSE
## 600                                     FALSE
## 729                                     FALSE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 70                                    TRUE
## 426                                   TRUE
## 500                                   TRUE
## 562                                   TRUE
## 600                                   TRUE
## 729                                   TRUE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs
## 70                                   0.7455660
## 426                                  0.5175626
## 500                                  0.6283889
## 562                                  0.5210199
## 600                                  0.5938542
## 729                                  0.8651290
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet
## 70                                              D
## 426                                             R
## 500                                             R
## 562                                             D
## 600                                             R
## 729                                             R
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## 70                                           0.3737626
## 426                                          0.4827789
## 500                                          0.4891710
## 562                                          0.4368080
## 600                                          0.4744747
## 729                                          0.7004556
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.is.acc
## 70                                                 FALSE
## 426                                                FALSE
## 500                                                FALSE
## 562                                                 TRUE
## 600                                                FALSE
## 729                                                FALSE
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err
## 70                                               TRUE
## 426                                              TRUE
## 500                                              TRUE
## 562                                             FALSE
## 600                                              TRUE
## 729                                              TRUE
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err.abs
## 70                                              0.6262374
## 426                                             0.4827789
## 500                                             0.4891710
## 562                                             0.4368080
## 600                                             0.4744747
## 729                                             0.7004556
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 70                                       D
## 426                                      R
## 500                                      R
## 562                                      R
## 600                                      R
## 729                                      R
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 70                                    0.3676866
## 426                                   0.5101833
## 500                                   0.4949738
## 562                                   0.4773279
## 600                                   0.5252663
## 729                                   0.7299054
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 70                                          FALSE
## 426                                         FALSE
## 500                                         FALSE
## 562                                         FALSE
## 600                                         FALSE
## 729                                         FALSE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 70                                        TRUE
## 426                                       TRUE
## 500                                       TRUE
## 562                                       TRUE
## 600                                       TRUE
## 729                                       TRUE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 70                                       0.6323134
## 426                                      0.5101833
## 500                                      0.4949738
## 562                                      0.4773279
## 600                                      0.5252663
## 729                                      0.7299054
##     Party.fctr.All.X.expoTrans.rcv.glmnet
## 70                                      D
## 426                                     R
## 500                                     R
## 562                                     R
## 600                                     R
## 729                                     R
##     Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 70                                   0.3675931
## 426                                  0.5101956
## 500                                  0.4950981
## 562                                  0.4773462
## 600                                  0.5252833
## 729                                  0.7299533
##     Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 70                                         FALSE
## 426                                        FALSE
## 500                                        FALSE
## 562                                        FALSE
## 600                                        FALSE
## 729                                        FALSE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 70                                       TRUE
## 426                                      TRUE
## 500                                      TRUE
## 562                                      TRUE
## 600                                      TRUE
## 729                                      TRUE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 70                                      0.6324069
## 426                                     0.5101956
## 500                                     0.4950981
## 562                                     0.4773462
## 600                                     0.5252833
## 729                                     0.7299533
##     Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 70                             D                         0.3668637
## 426                            R                         0.5113655
## 500                            R                         0.4948458
## 562                            R                         0.4763355
## 600                            R                         0.5240938
## 729                            R                         0.7304513
##     Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 70                                FALSE                             TRUE
## 426                               FALSE                             TRUE
## 500                               FALSE                             TRUE
## 562                               FALSE                             TRUE
## 600                               FALSE                             TRUE
## 729                               FALSE                             TRUE
##     Party.fctr.All.X..rcv.glmnet.err.abs
## 70                             0.6331363
## 426                            0.5113655
## 500                            0.4948458
## 562                            0.4763355
## 600                            0.5240938
## 729                            0.7304513
##     Party.fctr.All.X.conditionalX.rcv.glmnet
## 70                                         D
## 426                                        R
## 500                                        R
## 562                                        R
## 600                                        R
## 729                                        R
##     Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 70                                      0.3668637
## 426                                     0.5113655
## 500                                     0.4948458
## 562                                     0.4763355
## 600                                     0.5240938
## 729                                     0.7304513
##     Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 70                                            FALSE
## 426                                           FALSE
## 500                                           FALSE
## 562                                           FALSE
## 600                                           FALSE
## 729                                           FALSE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 70                                          TRUE
## 426                                         TRUE
## 500                                         TRUE
## 562                                         TRUE
## 600                                         TRUE
## 729                                         TRUE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 70                                         0.6331363
## 426                                        0.5113655
## 500                                        0.4948458
## 562                                        0.4763355
## 600                                        0.5240938
## 729                                        0.7304513
##     Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 70                               D                           0.3668637
## 426                              R                           0.5113655
## 500                              R                           0.4948458
## 562                              R                           0.4763355
## 600                              R                           0.5240938
## 729                              R                           0.7304513
##     Party.fctr.All.X.zv.rcv.glmnet.is.acc
## 70                                  FALSE
## 426                                 FALSE
## 500                                 FALSE
## 562                                 FALSE
## 600                                 FALSE
## 729                                 FALSE
##     Party.fctr.All.X.zv.rcv.glmnet.err
## 70                                TRUE
## 426                               TRUE
## 500                               TRUE
## 562                               TRUE
## 600                               TRUE
## 729                               TRUE
##     Party.fctr.All.X.zv.rcv.glmnet.err.abs
## 70                               0.6331363
## 426                              0.5113655
## 500                              0.4948458
## 562                              0.4763355
## 600                              0.5240938
## 729                              0.7304513
##     Party.fctr.All.X.center.rcv.glmnet
## 70                                   D
## 426                                  R
## 500                                  R
## 562                                  R
## 600                                  R
## 729                                  R
##     Party.fctr.All.X.center.rcv.glmnet.prob
## 70                                0.3668637
## 426                               0.5113655
## 500                               0.4948458
## 562                               0.4763355
## 600                               0.5240938
## 729                               0.7304513
##     Party.fctr.All.X.center.rcv.glmnet.is.acc
## 70                                      FALSE
## 426                                     FALSE
## 500                                     FALSE
## 562                                     FALSE
## 600                                     FALSE
## 729                                     FALSE
##     Party.fctr.All.X.center.rcv.glmnet.err
## 70                                    TRUE
## 426                                   TRUE
## 500                                   TRUE
## 562                                   TRUE
## 600                                   TRUE
## 729                                   TRUE
##     Party.fctr.All.X.center.rcv.glmnet.err.abs
## 70                                   0.6331363
## 426                                  0.5113655
## 500                                  0.4948458
## 562                                  0.4763355
## 600                                  0.5240938
## 729                                  0.7304513
##     Party.fctr.All.X.scale.rcv.glmnet
## 70                                  D
## 426                                 R
## 500                                 R
## 562                                 R
## 600                                 R
## 729                                 R
##     Party.fctr.All.X.scale.rcv.glmnet.prob
## 70                               0.3668637
## 426                              0.5113655
## 500                              0.4948458
## 562                              0.4763355
## 600                              0.5240938
## 729                              0.7304513
##     Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 70                                     FALSE
## 426                                    FALSE
## 500                                    FALSE
## 562                                    FALSE
## 600                                    FALSE
## 729                                    FALSE
##     Party.fctr.All.X.scale.rcv.glmnet.err
## 70                                   TRUE
## 426                                  TRUE
## 500                                  TRUE
## 562                                  TRUE
## 600                                  TRUE
## 729                                  TRUE
##     Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 70                                  0.6331363
## 426                                 0.5113655
## 500                                 0.4948458
## 562                                 0.4763355
## 600                                 0.5240938
## 729                                 0.7304513
##     Party.fctr.All.X.center.scale.rcv.glmnet
## 70                                         D
## 426                                        R
## 500                                        R
## 562                                        R
## 600                                        R
## 729                                        R
##     Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 70                                      0.3668637
## 426                                     0.5113655
## 500                                     0.4948458
## 562                                     0.4763355
## 600                                     0.5240938
## 729                                     0.7304513
##     Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 70                                            FALSE
## 426                                           FALSE
## 500                                           FALSE
## 562                                           FALSE
## 600                                           FALSE
## 729                                           FALSE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err
## 70                                          TRUE
## 426                                         TRUE
## 500                                         TRUE
## 562                                         TRUE
## 600                                         TRUE
## 729                                         TRUE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 70                                         0.6331363
## 426                                        0.5113655
## 500                                        0.4948458
## 562                                        0.4763355
## 600                                        0.5240938
## 729                                        0.7304513
##     Party.fctr.All.X.BoxCox.rcv.glmnet
## 70                                   D
## 426                                  R
## 500                                  R
## 562                                  R
## 600                                  R
## 729                                  R
##     Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 70                                0.3668637
## 426                               0.5113655
## 500                               0.4948458
## 562                               0.4763355
## 600                               0.5240938
## 729                               0.7304513
##     Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 70                                      FALSE
## 426                                     FALSE
## 500                                     FALSE
## 562                                     FALSE
## 600                                     FALSE
## 729                                     FALSE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 70                                    TRUE
## 426                                   TRUE
## 500                                   TRUE
## 562                                   TRUE
## 600                                   TRUE
## 729                                   TRUE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 70                                   0.6331363
## 426                                  0.5113655
## 500                                  0.4948458
## 562                                  0.4763355
## 600                                  0.5240938
## 729                                  0.7304513
##     Party.fctr.All.X.range.rcv.glmnet
## 70                                  D
## 426                                 R
## 500                                 R
## 562                                 R
## 600                                 R
## 729                                 R
##     Party.fctr.All.X.range.rcv.glmnet.prob
## 70                               0.3668637
## 426                              0.5113655
## 500                              0.4948458
## 562                              0.4763355
## 600                              0.5240938
## 729                              0.7304513
##     Party.fctr.All.X.range.rcv.glmnet.is.acc
## 70                                     FALSE
## 426                                    FALSE
## 500                                    FALSE
## 562                                    FALSE
## 600                                    FALSE
## 729                                    FALSE
##     Party.fctr.All.X.range.rcv.glmnet.err
## 70                                   TRUE
## 426                                  TRUE
## 500                                  TRUE
## 562                                  TRUE
## 600                                  TRUE
## 729                                  TRUE
##     Party.fctr.All.X.range.rcv.glmnet.err.abs Party.fctr.All.X..rcv.gbm
## 70                                  0.6331363                         D
## 426                                 0.5113655                         D
## 500                                 0.4948458                         R
## 562                                 0.4763355                         R
## 600                                 0.5240938                         R
## 729                                 0.7304513                         R
##     Party.fctr.All.X..rcv.gbm.prob Party.fctr.All.X..rcv.gbm.is.acc
## 70                       0.2855277                            FALSE
## 426                      0.4594820                             TRUE
## 500                      0.6359112                            FALSE
## 562                      0.5714126                            FALSE
## 600                      0.5247509                            FALSE
## 729                      0.5938901                            FALSE
##     Party.fctr.All.X..rcv.gbm.err Party.fctr.All.X..rcv.gbm.err.abs
## 70                           TRUE                         0.7144723
## 426                         FALSE                         0.4594820
## 500                          TRUE                         0.6359112
## 562                          TRUE                         0.5714126
## 600                          TRUE                         0.5247509
## 729                          TRUE                         0.5938901
##     Party.fctr.All.X..rcv.nnet Party.fctr.All.X..rcv.nnet.prob
## 70                           D                       0.1444532
## 426                          D                       0.1455822
## 500                          R                       0.7833004
## 562                          R                       0.7811683
## 600                          R                       0.7833393
## 729                          R                       0.7833399
##     Party.fctr.All.X..rcv.nnet.is.acc Party.fctr.All.X..rcv.nnet.err
## 70                              FALSE                           TRUE
## 426                              TRUE                          FALSE
## 500                             FALSE                           TRUE
## 562                             FALSE                           TRUE
## 600                             FALSE                           TRUE
## 729                             FALSE                           TRUE
##     Party.fctr.All.X..rcv.nnet.err.abs Party.fctr.All.X..rcv.earth
## 70                           0.8555468                           D
## 426                          0.1455822                           R
## 500                          0.7833004                           D
## 562                          0.7811683                           D
## 600                          0.7833393                           R
## 729                          0.7833399                           R
##     Party.fctr.All.X..rcv.earth.prob Party.fctr.All.X..rcv.earth.is.acc
## 70                         0.2370228                              FALSE
## 426                        0.5863765                              FALSE
## 500                        0.4940065                               TRUE
## 562                        0.4940065                               TRUE
## 600                        0.5863765                              FALSE
## 729                        0.9309095                              FALSE
##     Party.fctr.All.X..rcv.earth.err Party.fctr.All.X..rcv.earth.err.abs
## 70                             TRUE                           0.7629772
## 426                            TRUE                           0.5863765
## 500                           FALSE                           0.4940065
## 562                           FALSE                           0.4940065
## 600                            TRUE                           0.5863765
## 729                            TRUE                           0.9309095
##     Party.fctr.All.X..rcv.bayesglm Party.fctr.All.X..rcv.bayesglm.prob
## 70                               D                           0.1763514
## 426                              R                           0.6211378
## 500                              R                           0.6740041
## 562                              R                           0.5245943
## 600                              R                           0.6297283
## 729                              R                           0.7296342
##     Party.fctr.All.X..rcv.bayesglm.is.acc
## 70                                  FALSE
## 426                                 FALSE
## 500                                 FALSE
## 562                                 FALSE
## 600                                 FALSE
## 729                                 FALSE
##     Party.fctr.All.X..rcv.bayesglm.err
## 70                                TRUE
## 426                               TRUE
## 500                               TRUE
## 562                               TRUE
## 600                               TRUE
## 729                               TRUE
##     Party.fctr.All.X..rcv.bayesglm.err.abs Party.fctr.All.X..rcv.glm
## 70                               0.8236486                         D
## 426                              0.6211378                         R
## 500                              0.6740041                         R
## 562                              0.5245943                         R
## 600                              0.6297283                         R
## 729                              0.7296342                         R
##     Party.fctr.All.X..rcv.glm.prob Party.fctr.All.X..rcv.glm.is.acc
## 70                       0.1785975                            FALSE
## 426                      0.6244061                            FALSE
## 500                      0.6793495                            FALSE
## 562                      0.5248468                            FALSE
## 600                      0.6297394                            FALSE
## 729                      0.7229135                            FALSE
##     Party.fctr.All.X..rcv.glm.err Party.fctr.All.X..rcv.glm.err.abs
## 70                           TRUE                         0.8214025
## 426                          TRUE                         0.6244061
## 500                          TRUE                         0.6793495
## 562                          TRUE                         0.5248468
## 600                          TRUE                         0.6297394
## 729                          TRUE                         0.7229135
##     Party.fctr.All.X..rcv.bagEarth Party.fctr.All.X..rcv.bagEarth.prob
## 70                               D                           0.1686488
## 426                              D                           0.4935367
## 500                              R                           0.5957834
## 562                              D                           0.4911824
## 600                              R                           0.5871542
## 729                              R                           0.6180485
##     Party.fctr.All.X..rcv.bagEarth.is.acc
## 70                                  FALSE
## 426                                  TRUE
## 500                                 FALSE
## 562                                  TRUE
## 600                                 FALSE
## 729                                 FALSE
##     Party.fctr.All.X..rcv.bagEarth.err
## 70                                TRUE
## 426                              FALSE
## 500                               TRUE
## 562                              FALSE
## 600                               TRUE
## 729                               TRUE
##     Party.fctr.All.X..rcv.bagEarth.err.abs Party.fctr.All.X.nzv.rcv.glmnet
## 70                               0.8313512                               D
## 426                              0.4935367                               R
## 500                              0.5957834                               R
## 562                              0.4911824                               R
## 600                              0.5871542                               R
## 729                              0.6180485                               R
##     Party.fctr.All.X.nzv.rcv.glmnet.prob
## 70                             0.3611470
## 426                            0.5111653
## 500                            0.4958496
## 562                            0.4766174
## 600                            0.5243433
## 729                            0.7276517
##     Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 70                                   FALSE
## 426                                  FALSE
## 500                                  FALSE
## 562                                  FALSE
## 600                                  FALSE
## 729                                  FALSE
##     Party.fctr.All.X.nzv.rcv.glmnet.err
## 70                                 TRUE
## 426                                TRUE
## 500                                TRUE
## 562                                TRUE
## 600                                TRUE
## 729                                TRUE
##     Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.All.X..rcv.rf
## 70                                0.6388530                        R
## 426                               0.5111653                        D
## 500                               0.4958496                        D
## 562                               0.4766174                        D
## 600                               0.5243433                        D
## 729                               0.7276517                        D
##     Party.fctr.All.X..rcv.rf.prob Party.fctr.All.X..rcv.rf.is.acc
## 70                          0.748                            TRUE
## 426                         0.178                            TRUE
## 500                         0.260                            TRUE
## 562                         0.248                            TRUE
## 600                         0.206                            TRUE
## 729                         0.206                            TRUE
##     Party.fctr.All.X..rcv.rf.err Party.fctr.All.X..rcv.rf.err.abs
## 70                         FALSE                            0.252
## 426                        FALSE                            0.178
## 500                        FALSE                            0.260
## 562                        FALSE                            0.248
## 600                        FALSE                            0.206
## 729                        FALSE                            0.206
##     Party.fctr.All.X..rcv.avNNet Party.fctr.All.X..rcv.avNNet.prob
## 70                             D                         0.3631409
## 426                            D                         0.4380251
## 500                            D                         0.4480571
## 562                            D                         0.4322077
## 600                            D                         0.2356312
## 729                            R                         0.7896968
##     Party.fctr.All.X..rcv.avNNet.is.acc Party.fctr.All.X..rcv.avNNet.err
## 70                                FALSE                             TRUE
## 426                                TRUE                            FALSE
## 500                                TRUE                            FALSE
## 562                                TRUE                            FALSE
## 600                                TRUE                            FALSE
## 729                               FALSE                             TRUE
##     Party.fctr.All.X..rcv.avNNet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 70                             0.6368591                                D
## 426                            0.4380251                                R
## 500                            0.4480571                                R
## 562                            0.4322077                                R
## 600                            0.2356312                                R
## 729                            0.7896968                                R
##     Party.fctr.Low.cor.X..rcv.glmnet.prob
## 70                              0.3647318
## 426                             0.5108779
## 500                             0.4950335
## 562                             0.4760422
## 600                             0.5237310
## 729                             0.7304119
##     Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 70                                    FALSE
## 426                                   FALSE
## 500                                   FALSE
## 562                                   FALSE
## 600                                   FALSE
## 729                                   FALSE
##     Party.fctr.Low.cor.X..rcv.glmnet.err
## 70                                  TRUE
## 426                                 TRUE
## 500                                 TRUE
## 562                                 TRUE
## 600                                 TRUE
## 729                                 TRUE
##     Party.fctr.Low.cor.X..rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.glmnet
## 70                                 0.6352682                            D
## 426                                0.5108779                            R
## 500                                0.4950335                            R
## 562                                0.4760422                            R
## 600                                0.5237310                            R
## 729                                0.7304119                            R
##     Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 70                          0.4041615                               FALSE
## 426                         0.5310979                               FALSE
## 500                         0.5240342                               FALSE
## 562                         0.4638889                               FALSE
## 600                         0.5316846                               FALSE
## 729                         0.7207068                               FALSE
##     Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 70                              TRUE                            0.5958385
## 426                             TRUE                            0.5310979
## 500                             TRUE                            0.5240342
## 562                             TRUE                            0.4638889
## 600                             TRUE                            0.5316846
## 729                             TRUE                            0.7207068
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 70                                           D
## 426                                          R
## 500                                          R
## 562                                          R
## 600                                          R
## 729                                          D
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 70                                        0.3292065
## 426                                       0.5224378
## 500                                       0.5224378
## 562                                       0.5224378
## 600                                       0.5224378
## 729                                       0.3671420
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 70                                              FALSE
## 426                                             FALSE
## 500                                             FALSE
## 562                                             FALSE
## 600                                             FALSE
## 729                                              TRUE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 70                                            TRUE
## 426                                           TRUE
## 500                                           TRUE
## 562                                           TRUE
## 600                                           TRUE
## 729                                          FALSE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 70                                           0.6707935
## 426                                          0.5224378
## 500                                          0.5224378
## 562                                          0.5224378
## 600                                          0.5224378
## 729                                          0.3671420
##     Party.fctr.All.X.spatialSign.rcv.glmnet
## 70                                        D
## 426                                       D
## 500                                       D
## 562                                       D
## 600                                       R
## 729                                       R
##     Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 70                                     0.3669491
## 426                                    0.4998752
## 500                                    0.4922469
## 562                                    0.4928968
## 600                                    0.5166248
## 729                                    0.6351164
##     Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 70                                           FALSE
## 426                                           TRUE
## 500                                           TRUE
## 562                                           TRUE
## 600                                          FALSE
## 729                                          FALSE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 70                                         TRUE
## 426                                       FALSE
## 500                                       FALSE
## 562                                       FALSE
## 600                                        TRUE
## 729                                        TRUE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 70                                        0.6330509
## 426                                       0.4998752
## 500                                       0.4922469
## 562                                       0.4928968
## 600                                       0.5166248
## 729                                       0.6351164
##     Party.fctr.All.X..rcv.rpart Party.fctr.All.X..rcv.rpart.prob
## 70                            D                        0.2330827
## 426                           D                        0.5385802
## 500                           D                        0.5385802
## 562                           D                        0.5385802
## 600                           D                        0.5385802
## 729                           R                        0.6225490
##     Party.fctr.All.X..rcv.rpart.is.acc Party.fctr.All.X..rcv.rpart.err
## 70                               FALSE                            TRUE
## 426                               TRUE                           FALSE
## 500                               TRUE                           FALSE
## 562                               TRUE                           FALSE
## 600                               TRUE                           FALSE
## 729                              FALSE                            TRUE
##     Party.fctr.All.X..rcv.rpart.err.abs
## 70                            0.7669173
## 426                           0.5385802
## 500                           0.5385802
## 562                           0.5385802
## 600                           0.5385802
## 729                           0.6225490
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet
## 70                                      D
## 426                                     D
## 500                                     D
## 562                                     D
## 600                                     D
## 729                                     D
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## 70                                   0.3479286
## 426                                  0.5122987
## 500                                  0.5122987
## 562                                  0.5122987
## 600                                  0.5122987
## 729                                  0.5122987
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.is.acc
## 70                                         FALSE
## 426                                         TRUE
## 500                                         TRUE
## 562                                         TRUE
## 600                                         TRUE
## 729                                         TRUE
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err
## 70                                       TRUE
## 426                                     FALSE
## 500                                     FALSE
## 562                                     FALSE
## 600                                     FALSE
## 729                                     FALSE
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err.abs
## 70                                      0.6520714
## 426                                     0.5122987
## 500                                     0.5122987
## 562                                     0.5122987
## 600                                     0.5122987
## 729                                     0.5122987
##     Party.fctr.Max.cor.Y..rcv.rpart Party.fctr.Max.cor.Y..rcv.rpart.prob
## 70                                D                             0.300000
## 426                               R                             0.521265
## 500                               R                             0.521265
## 562                               R                             0.521265
## 600                               R                             0.521265
## 729                               R                             0.521265
##     Party.fctr.Max.cor.Y..rcv.rpart.is.acc
## 70                                   FALSE
## 426                                  FALSE
## 500                                  FALSE
## 562                                  FALSE
## 600                                  FALSE
## 729                                  FALSE
##     Party.fctr.Max.cor.Y..rcv.rpart.err
## 70                                 TRUE
## 426                                TRUE
## 500                                TRUE
## 562                                TRUE
## 600                                TRUE
## 729                                TRUE
##     Party.fctr.Max.cor.Y..rcv.rpart.err.abs
## 70                                 0.700000
## 426                                0.521265
## 500                                0.521265
## 562                                0.521265
## 600                                0.521265
## 729                                0.521265
##     Party.fctr.All.X.ica.rcv.glmnet Party.fctr.All.X.ica.rcv.glmnet.prob
## 70                                D                            0.4610633
## 426                               D                            0.4907410
## 500                               D                            0.4673908
## 562                               D                            0.4582487
## 600                               D                            0.4850992
## 729                               D                            0.4487614
##     Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 70                                   FALSE
## 426                                   TRUE
## 500                                   TRUE
## 562                                   TRUE
## 600                                   TRUE
## 729                                   TRUE
##     Party.fctr.All.X.ica.rcv.glmnet.err
## 70                                 TRUE
## 426                               FALSE
## 500                               FALSE
## 562                               FALSE
## 600                               FALSE
## 729                               FALSE
##     Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 70                                0.5389367
## 426                               0.4907410
## 500                               0.4673908
## 562                               0.4582487
## 600                               0.4850992
## 729                               0.4487614
##     Party.fctr.Final.All.X.zv.pca..glmnet.prob
## 70                                   0.3218174
## 426                                  0.4982374
## 500                                  0.5234933
## 562                                  0.5466003
## 600                                  0.5717076
## 729                                  0.7996728
##     Party.fctr.Final.All.X.zv.pca..glmnet
## 70                                      D
## 426                                     R
## 500                                     R
## 562                                     R
## 600                                     R
## 729                                     R
##     Party.fctr.Final.All.X.zv.pca..glmnet.err
## 70                                       TRUE
## 426                                      TRUE
## 500                                      TRUE
## 562                                      TRUE
## 600                                      TRUE
## 729                                      TRUE
##     Party.fctr.Final.All.X.zv.pca..glmnet.err.abs
## 70                                      0.6781826
## 426                                     0.4982374
## 500                                     0.5234933
## 562                                     0.5466003
## 600                                     0.5717076
## 729                                     0.7996728
##     Party.fctr.Final.All.X.zv.pca..glmnet.is.acc
## 70                                         FALSE
## 426                                        FALSE
## 500                                        FALSE
## 562                                        FALSE
## 600                                        FALSE
## 729                                        FALSE
##     Party.fctr.Final.All.X.zv.pca..glmnet.accurate
## 70                                           FALSE
## 426                                          FALSE
## 500                                          FALSE
## 562                                          FALSE
## 600                                          FALSE
## 729                                          FALSE
##     Party.fctr.Final.All.X.zv.pca..glmnet.error
## 70                                  -0.12818258
## 426                                  0.04823737
## 500                                  0.07349329
## 562                                  0.09660031
## 600                                  0.12170760
## 729                                  0.34967279
##     USER_ID Party.fctr Party.fctr.All.X.zv.pca.rcv.glmnet
## 727    1538          D                                  R
## 728    6053          D                                  R
## 729    2495          D                                  R
## 730    4350          D                                  R
## 731    4361          D                                  R
## 732    3431          D                                  R
##     Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 727                               0.7803481
## 728                               0.7755771
## 729                               0.8651290
## 730                               0.7529986
## 731                               0.9053814
## 732                               0.9329386
##     Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 727                                     FALSE
## 728                                     FALSE
## 729                                     FALSE
## 730                                     FALSE
## 731                                     FALSE
## 732                                     FALSE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 727                                   TRUE
## 728                                   TRUE
## 729                                   TRUE
## 730                                   TRUE
## 731                                   TRUE
## 732                                   TRUE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs
## 727                                  0.7803481
## 728                                  0.7755771
## 729                                  0.8651290
## 730                                  0.7529986
## 731                                  0.9053814
## 732                                  0.9329386
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet
## 727                                             R
## 728                                             R
## 729                                             R
## 730                                             R
## 731                                             R
## 732                                             R
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.prob
## 727                                          0.6622853
## 728                                          0.5840539
## 729                                          0.7004556
## 730                                          0.6232594
## 731                                          0.7246530
## 732                                          0.6312103
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.is.acc
## 727                                                FALSE
## 728                                                FALSE
## 729                                                FALSE
## 730                                                FALSE
## 731                                                FALSE
## 732                                                FALSE
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err
## 727                                              TRUE
## 728                                              TRUE
## 729                                              TRUE
## 730                                              TRUE
## 731                                              TRUE
## 732                                              TRUE
##     Party.fctr.All.X.zv.YeoJohnson.pca.rcv.glmnet.err.abs
## 727                                             0.6622853
## 728                                             0.5840539
## 729                                             0.7004556
## 730                                             0.6232594
## 731                                             0.7246530
## 732                                             0.6312103
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 727                                      R
## 728                                      R
## 729                                      R
## 730                                      R
## 731                                      R
## 732                                      R
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 727                                   0.6930173
## 728                                   0.4795182
## 729                                   0.7299054
## 730                                   0.6429092
## 731                                   0.6860480
## 732                                   0.6486672
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 727                                         FALSE
## 728                                         FALSE
## 729                                         FALSE
## 730                                         FALSE
## 731                                         FALSE
## 732                                         FALSE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 727                                       TRUE
## 728                                       TRUE
## 729                                       TRUE
## 730                                       TRUE
## 731                                       TRUE
## 732                                       TRUE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 727                                      0.6930173
## 728                                      0.4795182
## 729                                      0.7299054
## 730                                      0.6429092
## 731                                      0.6860480
## 732                                      0.6486672
##     Party.fctr.All.X.expoTrans.rcv.glmnet
## 727                                     R
## 728                                     R
## 729                                     R
## 730                                     R
## 731                                     R
## 732                                     R
##     Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 727                                  0.6930370
## 728                                  0.4794746
## 729                                  0.7299533
## 730                                  0.6429143
## 731                                  0.6861798
## 732                                  0.6486920
##     Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 727                                        FALSE
## 728                                        FALSE
## 729                                        FALSE
## 730                                        FALSE
## 731                                        FALSE
## 732                                        FALSE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 727                                      TRUE
## 728                                      TRUE
## 729                                      TRUE
## 730                                      TRUE
## 731                                      TRUE
## 732                                      TRUE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 727                                     0.6930370
## 728                                     0.4794746
## 729                                     0.7299533
## 730                                     0.6429143
## 731                                     0.6861798
## 732                                     0.6486920
##     Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 727                            R                         0.6937111
## 728                            R                         0.4788302
## 729                            R                         0.7304513
## 730                            R                         0.6431843
## 731                            R                         0.6854357
## 732                            R                         0.6495350
##     Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 727                               FALSE                             TRUE
## 728                               FALSE                             TRUE
## 729                               FALSE                             TRUE
## 730                               FALSE                             TRUE
## 731                               FALSE                             TRUE
## 732                               FALSE                             TRUE
##     Party.fctr.All.X..rcv.glmnet.err.abs
## 727                            0.6937111
## 728                            0.4788302
## 729                            0.7304513
## 730                            0.6431843
## 731                            0.6854357
## 732                            0.6495350
##     Party.fctr.All.X.conditionalX.rcv.glmnet
## 727                                        R
## 728                                        R
## 729                                        R
## 730                                        R
## 731                                        R
## 732                                        R
##     Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 727                                     0.6937111
## 728                                     0.4788302
## 729                                     0.7304513
## 730                                     0.6431843
## 731                                     0.6854357
## 732                                     0.6495350
##     Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 727                                           FALSE
## 728                                           FALSE
## 729                                           FALSE
## 730                                           FALSE
## 731                                           FALSE
## 732                                           FALSE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 727                                         TRUE
## 728                                         TRUE
## 729                                         TRUE
## 730                                         TRUE
## 731                                         TRUE
## 732                                         TRUE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 727                                        0.6937111
## 728                                        0.4788302
## 729                                        0.7304513
## 730                                        0.6431843
## 731                                        0.6854357
## 732                                        0.6495350
##     Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 727                              R                           0.6937111
## 728                              R                           0.4788302
## 729                              R                           0.7304513
## 730                              R                           0.6431843
## 731                              R                           0.6854357
## 732                              R                           0.6495350
##     Party.fctr.All.X.zv.rcv.glmnet.is.acc
## 727                                 FALSE
## 728                                 FALSE
## 729                                 FALSE
## 730                                 FALSE
## 731                                 FALSE
## 732                                 FALSE
##     Party.fctr.All.X.zv.rcv.glmnet.err
## 727                               TRUE
## 728                               TRUE
## 729                               TRUE
## 730                               TRUE
## 731                               TRUE
## 732                               TRUE
##     Party.fctr.All.X.zv.rcv.glmnet.err.abs
## 727                              0.6937111
## 728                              0.4788302
## 729                              0.7304513
## 730                              0.6431843
## 731                              0.6854357
## 732                              0.6495350
##     Party.fctr.All.X.center.rcv.glmnet
## 727                                  R
## 728                                  R
## 729                                  R
## 730                                  R
## 731                                  R
## 732                                  R
##     Party.fctr.All.X.center.rcv.glmnet.prob
## 727                               0.6937111
## 728                               0.4788302
## 729                               0.7304513
## 730                               0.6431843
## 731                               0.6854357
## 732                               0.6495350
##     Party.fctr.All.X.center.rcv.glmnet.is.acc
## 727                                     FALSE
## 728                                     FALSE
## 729                                     FALSE
## 730                                     FALSE
## 731                                     FALSE
## 732                                     FALSE
##     Party.fctr.All.X.center.rcv.glmnet.err
## 727                                   TRUE
## 728                                   TRUE
## 729                                   TRUE
## 730                                   TRUE
## 731                                   TRUE
## 732                                   TRUE
##     Party.fctr.All.X.center.rcv.glmnet.err.abs
## 727                                  0.6937111
## 728                                  0.4788302
## 729                                  0.7304513
## 730                                  0.6431843
## 731                                  0.6854357
## 732                                  0.6495350
##     Party.fctr.All.X.scale.rcv.glmnet
## 727                                 R
## 728                                 R
## 729                                 R
## 730                                 R
## 731                                 R
## 732                                 R
##     Party.fctr.All.X.scale.rcv.glmnet.prob
## 727                              0.6937111
## 728                              0.4788302
## 729                              0.7304513
## 730                              0.6431843
## 731                              0.6854357
## 732                              0.6495350
##     Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 727                                    FALSE
## 728                                    FALSE
## 729                                    FALSE
## 730                                    FALSE
## 731                                    FALSE
## 732                                    FALSE
##     Party.fctr.All.X.scale.rcv.glmnet.err
## 727                                  TRUE
## 728                                  TRUE
## 729                                  TRUE
## 730                                  TRUE
## 731                                  TRUE
## 732                                  TRUE
##     Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 727                                 0.6937111
## 728                                 0.4788302
## 729                                 0.7304513
## 730                                 0.6431843
## 731                                 0.6854357
## 732                                 0.6495350
##     Party.fctr.All.X.center.scale.rcv.glmnet
## 727                                        R
## 728                                        R
## 729                                        R
## 730                                        R
## 731                                        R
## 732                                        R
##     Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 727                                     0.6937111
## 728                                     0.4788302
## 729                                     0.7304513
## 730                                     0.6431843
## 731                                     0.6854357
## 732                                     0.6495350
##     Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 727                                           FALSE
## 728                                           FALSE
## 729                                           FALSE
## 730                                           FALSE
## 731                                           FALSE
## 732                                           FALSE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err
## 727                                         TRUE
## 728                                         TRUE
## 729                                         TRUE
## 730                                         TRUE
## 731                                         TRUE
## 732                                         TRUE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 727                                        0.6937111
## 728                                        0.4788302
## 729                                        0.7304513
## 730                                        0.6431843
## 731                                        0.6854357
## 732                                        0.6495350
##     Party.fctr.All.X.BoxCox.rcv.glmnet
## 727                                  R
## 728                                  R
## 729                                  R
## 730                                  R
## 731                                  R
## 732                                  R
##     Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 727                               0.6937111
## 728                               0.4788302
## 729                               0.7304513
## 730                               0.6431843
## 731                               0.6854357
## 732                               0.6495350
##     Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 727                                     FALSE
## 728                                     FALSE
## 729                                     FALSE
## 730                                     FALSE
## 731                                     FALSE
## 732                                     FALSE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 727                                   TRUE
## 728                                   TRUE
## 729                                   TRUE
## 730                                   TRUE
## 731                                   TRUE
## 732                                   TRUE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 727                                  0.6937111
## 728                                  0.4788302
## 729                                  0.7304513
## 730                                  0.6431843
## 731                                  0.6854357
## 732                                  0.6495350
##     Party.fctr.All.X.range.rcv.glmnet
## 727                                 R
## 728                                 R
## 729                                 R
## 730                                 R
## 731                                 R
## 732                                 R
##     Party.fctr.All.X.range.rcv.glmnet.prob
## 727                              0.6937111
## 728                              0.4788302
## 729                              0.7304513
## 730                              0.6431843
## 731                              0.6854357
## 732                              0.6495350
##     Party.fctr.All.X.range.rcv.glmnet.is.acc
## 727                                    FALSE
## 728                                    FALSE
## 729                                    FALSE
## 730                                    FALSE
## 731                                    FALSE
## 732                                    FALSE
##     Party.fctr.All.X.range.rcv.glmnet.err
## 727                                  TRUE
## 728                                  TRUE
## 729                                  TRUE
## 730                                  TRUE
## 731                                  TRUE
## 732                                  TRUE
##     Party.fctr.All.X.range.rcv.glmnet.err.abs Party.fctr.All.X..rcv.gbm
## 727                                 0.6937111                         R
## 728                                 0.4788302                         R
## 729                                 0.7304513                         R
## 730                                 0.6431843                         D
## 731                                 0.6854357                         R
## 732                                 0.6495350                         R
##     Party.fctr.All.X..rcv.gbm.prob Party.fctr.All.X..rcv.gbm.is.acc
## 727                      0.5602591                            FALSE
## 728                      0.6022095                            FALSE
## 729                      0.5938901                            FALSE
## 730                      0.4495837                             TRUE
## 731                      0.6500572                            FALSE
## 732                      0.6668366                            FALSE
##     Party.fctr.All.X..rcv.gbm.err Party.fctr.All.X..rcv.gbm.err.abs
## 727                          TRUE                         0.5602591
## 728                          TRUE                         0.6022095
## 729                          TRUE                         0.5938901
## 730                         FALSE                         0.4495837
## 731                          TRUE                         0.6500572
## 732                          TRUE                         0.6668366
##     Party.fctr.All.X..rcv.nnet Party.fctr.All.X..rcv.nnet.prob
## 727                          R                       0.7833399
## 728                          R                       0.7833399
## 729                          R                       0.7833399
## 730                          R                       0.7833399
## 731                          R                       0.7833399
## 732                          R                       0.7833399
##     Party.fctr.All.X..rcv.nnet.is.acc Party.fctr.All.X..rcv.nnet.err
## 727                             FALSE                           TRUE
## 728                             FALSE                           TRUE
## 729                             FALSE                           TRUE
## 730                             FALSE                           TRUE
## 731                             FALSE                           TRUE
## 732                             FALSE                           TRUE
##     Party.fctr.All.X..rcv.nnet.err.abs Party.fctr.All.X..rcv.earth
## 727                          0.7833399                           R
## 728                          0.7833399                           D
## 729                          0.7833399                           R
## 730                          0.7833399                           R
## 731                          0.7833399                           R
## 732                          0.7833399                           R
##     Party.fctr.All.X..rcv.earth.prob Party.fctr.All.X..rcv.earth.is.acc
## 727                        0.8490961                              FALSE
## 728                        0.4951513                               TRUE
## 729                        0.9309095                              FALSE
## 730                        0.7412024                              FALSE
## 731                        0.7462187                              FALSE
## 732                        0.8102143                              FALSE
##     Party.fctr.All.X..rcv.earth.err Party.fctr.All.X..rcv.earth.err.abs
## 727                            TRUE                           0.8490961
## 728                           FALSE                           0.4951513
## 729                            TRUE                           0.9309095
## 730                            TRUE                           0.7412024
## 731                            TRUE                           0.7462187
## 732                            TRUE                           0.8102143
##     Party.fctr.All.X..rcv.bayesglm Party.fctr.All.X..rcv.bayesglm.prob
## 727                              R                           0.7786284
## 728                              R                           0.7953554
## 729                              R                           0.7296342
## 730                              R                           0.7803312
## 731                              R                           0.8282327
## 732                              R                           0.9827616
##     Party.fctr.All.X..rcv.bayesglm.is.acc
## 727                                 FALSE
## 728                                 FALSE
## 729                                 FALSE
## 730                                 FALSE
## 731                                 FALSE
## 732                                 FALSE
##     Party.fctr.All.X..rcv.bayesglm.err
## 727                               TRUE
## 728                               TRUE
## 729                               TRUE
## 730                               TRUE
## 731                               TRUE
## 732                               TRUE
##     Party.fctr.All.X..rcv.bayesglm.err.abs Party.fctr.All.X..rcv.glm
## 727                              0.7786284                         R
## 728                              0.7953554                         R
## 729                              0.7296342                         R
## 730                              0.7803312                         R
## 731                              0.8282327                         R
## 732                              0.9827616                         R
##     Party.fctr.All.X..rcv.glm.prob Party.fctr.All.X..rcv.glm.is.acc
## 727                      0.7742563                            FALSE
## 728                      0.8016424                            FALSE
## 729                      0.7229135                            FALSE
## 730                      0.7837171                            FALSE
## 731                      0.8168588                            FALSE
## 732                      0.9851010                            FALSE
##     Party.fctr.All.X..rcv.glm.err Party.fctr.All.X..rcv.glm.err.abs
## 727                          TRUE                         0.7742563
## 728                          TRUE                         0.8016424
## 729                          TRUE                         0.7229135
## 730                          TRUE                         0.7837171
## 731                          TRUE                         0.8168588
## 732                          TRUE                         0.9851010
##     Party.fctr.All.X..rcv.bagEarth Party.fctr.All.X..rcv.bagEarth.prob
## 727                              R                           0.7792907
## 728                              R                           0.7122612
## 729                              R                           0.6180485
## 730                              R                           0.7414671
## 731                              R                           0.7143307
## 732                              R                           0.8638982
##     Party.fctr.All.X..rcv.bagEarth.is.acc
## 727                                 FALSE
## 728                                 FALSE
## 729                                 FALSE
## 730                                 FALSE
## 731                                 FALSE
## 732                                 FALSE
##     Party.fctr.All.X..rcv.bagEarth.err
## 727                               TRUE
## 728                               TRUE
## 729                               TRUE
## 730                               TRUE
## 731                               TRUE
## 732                               TRUE
##     Party.fctr.All.X..rcv.bagEarth.err.abs Party.fctr.All.X.nzv.rcv.glmnet
## 727                              0.7792907                               R
## 728                              0.7122612                               R
## 729                              0.6180485                               R
## 730                              0.7414671                               R
## 731                              0.7143307                               R
## 732                              0.8638982                               R
##     Party.fctr.All.X.nzv.rcv.glmnet.prob
## 727                            0.6905703
## 728                            0.4798541
## 729                            0.7276517
## 730                            0.6657469
## 731                            0.6841193
## 732                            0.6477985
##     Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 727                                  FALSE
## 728                                  FALSE
## 729                                  FALSE
## 730                                  FALSE
## 731                                  FALSE
## 732                                  FALSE
##     Party.fctr.All.X.nzv.rcv.glmnet.err
## 727                                TRUE
## 728                                TRUE
## 729                                TRUE
## 730                                TRUE
## 731                                TRUE
## 732                                TRUE
##     Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.All.X..rcv.rf
## 727                               0.6905703                        D
## 728                               0.4798541                        D
## 729                               0.7276517                        D
## 730                               0.6657469                        D
## 731                               0.6841193                        R
## 732                               0.6477985                        D
##     Party.fctr.All.X..rcv.rf.prob Party.fctr.All.X..rcv.rf.is.acc
## 727                         0.206                            TRUE
## 728                         0.228                            TRUE
## 729                         0.206                            TRUE
## 730                         0.178                            TRUE
## 731                         0.646                           FALSE
## 732                         0.172                            TRUE
##     Party.fctr.All.X..rcv.rf.err Party.fctr.All.X..rcv.rf.err.abs
## 727                        FALSE                            0.206
## 728                        FALSE                            0.228
## 729                        FALSE                            0.206
## 730                        FALSE                            0.178
## 731                         TRUE                            0.646
## 732                        FALSE                            0.172
##     Party.fctr.All.X..rcv.avNNet Party.fctr.All.X..rcv.avNNet.prob
## 727                            R                         0.7709107
## 728                            D                         0.3730336
## 729                            R                         0.7896968
## 730                            R                         0.7975137
## 731                            R                         0.7536152
## 732                            R                         0.8162250
##     Party.fctr.All.X..rcv.avNNet.is.acc Party.fctr.All.X..rcv.avNNet.err
## 727                               FALSE                             TRUE
## 728                                TRUE                            FALSE
## 729                               FALSE                             TRUE
## 730                               FALSE                             TRUE
## 731                               FALSE                             TRUE
## 732                               FALSE                             TRUE
##     Party.fctr.All.X..rcv.avNNet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 727                            0.7709107                                R
## 728                            0.3730336                                R
## 729                            0.7896968                                R
## 730                            0.7975137                                R
## 731                            0.7536152                                R
## 732                            0.8162250                                R
##     Party.fctr.Low.cor.X..rcv.glmnet.prob
## 727                             0.6981647
## 728                             0.4739222
## 729                             0.7304119
## 730                             0.6322402
## 731                             0.7062437
## 732                             0.6308609
##     Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 727                                   FALSE
## 728                                   FALSE
## 729                                   FALSE
## 730                                   FALSE
## 731                                   FALSE
## 732                                   FALSE
##     Party.fctr.Low.cor.X..rcv.glmnet.err
## 727                                 TRUE
## 728                                 TRUE
## 729                                 TRUE
## 730                                 TRUE
## 731                                 TRUE
## 732                                 TRUE
##     Party.fctr.Low.cor.X..rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.glmnet
## 727                                0.6981647                            R
## 728                                0.4739222                            D
## 729                                0.7304119                            R
## 730                                0.6322402                            R
## 731                                0.7062437                            R
## 732                                0.6308609                            R
##     Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 727                         0.7904739                               FALSE
## 728                         0.3200914                                TRUE
## 729                         0.7207068                               FALSE
## 730                         0.7572454                               FALSE
## 731                         0.7874528                               FALSE
## 732                         0.6445720                               FALSE
##     Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 727                             TRUE                            0.7904739
## 728                            FALSE                            0.3200914
## 729                             TRUE                            0.7207068
## 730                             TRUE                            0.7572454
## 731                             TRUE                            0.7874528
## 732                             TRUE                            0.6445720
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 727                                          D
## 728                                          D
## 729                                          D
## 730                                          R
## 731                                          R
## 732                                          R
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 727                                       0.4249582
## 728                                       0.4264943
## 729                                       0.3671420
## 730                                       0.6114567
## 731                                       0.5249303
## 732                                       0.5592429
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 727                                              TRUE
## 728                                              TRUE
## 729                                              TRUE
## 730                                             FALSE
## 731                                             FALSE
## 732                                             FALSE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 727                                          FALSE
## 728                                          FALSE
## 729                                          FALSE
## 730                                           TRUE
## 731                                           TRUE
## 732                                           TRUE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 727                                          0.4249582
## 728                                          0.4264943
## 729                                          0.3671420
## 730                                          0.6114567
## 731                                          0.5249303
## 732                                          0.5592429
##     Party.fctr.All.X.spatialSign.rcv.glmnet
## 727                                       R
## 728                                       D
## 729                                       R
## 730                                       R
## 731                                       R
## 732                                       R
##     Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 727                                    0.6033326
## 728                                    0.4327106
## 729                                    0.6351164
## 730                                    0.5742117
## 731                                    0.6301253
## 732                                    0.5725896
##     Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 727                                          FALSE
## 728                                           TRUE
## 729                                          FALSE
## 730                                          FALSE
## 731                                          FALSE
## 732                                          FALSE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 727                                        TRUE
## 728                                       FALSE
## 729                                        TRUE
## 730                                        TRUE
## 731                                        TRUE
## 732                                        TRUE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 727                                       0.6033326
## 728                                       0.4327106
## 729                                       0.6351164
## 730                                       0.5742117
## 731                                       0.6301253
## 732                                       0.5725896
##     Party.fctr.All.X..rcv.rpart Party.fctr.All.X..rcv.rpart.prob
## 727                           R                        0.6225490
## 728                           D                        0.4269231
## 729                           R                        0.6225490
## 730                           R                        0.6225490
## 731                           R                        0.6225490
## 732                           R                        0.6225490
##     Party.fctr.All.X..rcv.rpart.is.acc Party.fctr.All.X..rcv.rpart.err
## 727                              FALSE                            TRUE
## 728                               TRUE                           FALSE
## 729                              FALSE                            TRUE
## 730                              FALSE                            TRUE
## 731                              FALSE                            TRUE
## 732                              FALSE                            TRUE
##     Party.fctr.All.X..rcv.rpart.err.abs
## 727                           0.6225490
## 728                           0.4269231
## 729                           0.6225490
## 730                           0.6225490
## 731                           0.6225490
## 732                           0.6225490
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet
## 727                                     R
## 728                                     D
## 729                                     D
## 730                                     R
## 731                                     R
## 732                                     D
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.prob
## 727                                  0.5531271
## 728                                  0.4206517
## 729                                  0.5122987
## 730                                  0.5531271
## 731                                  0.5531271
## 732                                  0.4610815
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.is.acc
## 727                                        FALSE
## 728                                         TRUE
## 729                                         TRUE
## 730                                        FALSE
## 731                                        FALSE
## 732                                         TRUE
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err
## 727                                      TRUE
## 728                                     FALSE
## 729                                     FALSE
## 730                                      TRUE
## 731                                      TRUE
## 732                                     FALSE
##     Party.fctr.Max.cor.Y.rcv.1X1...glmnet.err.abs
## 727                                     0.5531271
## 728                                     0.4206517
## 729                                     0.5122987
## 730                                     0.5531271
## 731                                     0.5531271
## 732                                     0.4610815
##     Party.fctr.Max.cor.Y..rcv.rpart Party.fctr.Max.cor.Y..rcv.rpart.prob
## 727                               R                            0.5212650
## 728                               D                            0.4231928
## 729                               R                            0.5212650
## 730                               R                            0.5212650
## 731                               R                            0.5212650
## 732                               D                            0.4231928
##     Party.fctr.Max.cor.Y..rcv.rpart.is.acc
## 727                                  FALSE
## 728                                   TRUE
## 729                                  FALSE
## 730                                  FALSE
## 731                                  FALSE
## 732                                   TRUE
##     Party.fctr.Max.cor.Y..rcv.rpart.err
## 727                                TRUE
## 728                               FALSE
## 729                                TRUE
## 730                                TRUE
## 731                                TRUE
## 732                               FALSE
##     Party.fctr.Max.cor.Y..rcv.rpart.err.abs
## 727                               0.5212650
## 728                               0.4231928
## 729                               0.5212650
## 730                               0.5212650
## 731                               0.5212650
## 732                               0.4231928
##     Party.fctr.All.X.ica.rcv.glmnet Party.fctr.All.X.ica.rcv.glmnet.prob
## 727                               D                            0.4408493
## 728                               D                            0.4720174
## 729                               D                            0.4487614
## 730                               D                            0.4447195
## 731                               D                            0.4612744
## 732                               D                            0.4479286
##     Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 727                                   TRUE
## 728                                   TRUE
## 729                                   TRUE
## 730                                   TRUE
## 731                                   TRUE
## 732                                   TRUE
##     Party.fctr.All.X.ica.rcv.glmnet.err
## 727                               FALSE
## 728                               FALSE
## 729                               FALSE
## 730                               FALSE
## 731                               FALSE
## 732                               FALSE
##     Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 727                               0.4408493
## 728                               0.4720174
## 729                               0.4487614
## 730                               0.4447195
## 731                               0.4612744
## 732                               0.4479286
##     Party.fctr.Final.All.X.zv.pca..glmnet.prob
## 727                                  0.7896524
## 728                                  0.7911609
## 729                                  0.7996728
## 730                                  0.8214812
## 731                                  0.8453652
## 732                                  0.8825761
##     Party.fctr.Final.All.X.zv.pca..glmnet
## 727                                     R
## 728                                     R
## 729                                     R
## 730                                     R
## 731                                     R
## 732                                     R
##     Party.fctr.Final.All.X.zv.pca..glmnet.err
## 727                                      TRUE
## 728                                      TRUE
## 729                                      TRUE
## 730                                      TRUE
## 731                                      TRUE
## 732                                      TRUE
##     Party.fctr.Final.All.X.zv.pca..glmnet.err.abs
## 727                                     0.7896524
## 728                                     0.7911609
## 729                                     0.7996728
## 730                                     0.8214812
## 731                                     0.8453652
## 732                                     0.8825761
##     Party.fctr.Final.All.X.zv.pca..glmnet.is.acc
## 727                                        FALSE
## 728                                        FALSE
## 729                                        FALSE
## 730                                        FALSE
## 731                                        FALSE
## 732                                        FALSE
##     Party.fctr.Final.All.X.zv.pca..glmnet.accurate
## 727                                          FALSE
## 728                                          FALSE
## 729                                          FALSE
## 730                                          FALSE
## 731                                          FALSE
## 732                                          FALSE
##     Party.fctr.Final.All.X.zv.pca..glmnet.error
## 727                                   0.3396524
## 728                                   0.3411609
## 729                                   0.3496728
## 730                                   0.3714812
## 731                                   0.3953652
## 732                                   0.4325761

dsp_feats_vctr <- c(NULL)
for(var in grep(".imp", names(glb_feats_df), fixed=TRUE, value=TRUE))
    dsp_feats_vctr <- union(dsp_feats_vctr, 
                            glb_feats_df[!is.na(glb_feats_df[, var]), "id"])

# print(glbObsTrn[glbObsTrn$UniqueID %in% FN_OOB_ids, 
#                     grep(glb_rsp_var, names(glbObsTrn), value=TRUE)])

print(setdiff(names(glbObsTrn), names(glbObsAll)))
## [1] "Party.fctr.Final.All.X.zv.pca..glmnet.prob"   
## [2] "Party.fctr.Final.All.X.zv.pca..glmnet"        
## [3] "Party.fctr.Final.All.X.zv.pca..glmnet.err"    
## [4] "Party.fctr.Final.All.X.zv.pca..glmnet.err.abs"
## [5] "Party.fctr.Final.All.X.zv.pca..glmnet.is.acc"
for (col in setdiff(names(glbObsTrn), names(glbObsAll)))
    # Merge or cbind ?
    glbObsAll[glbObsAll$.src == "Train", col] <- glbObsTrn[, col]

print(setdiff(names(glbObsFit), names(glbObsAll)))
## character(0)
print(setdiff(names(glbObsOOB), names(glbObsAll)))
## character(0)
for (col in setdiff(names(glbObsOOB), names(glbObsAll)))
    # Merge or cbind ?
    glbObsAll[glbObsAll$.lcn == "OOB", col] <- glbObsOOB[, col]
    
print(setdiff(names(glbObsNew), names(glbObsAll)))
## character(0)
#glb2Sav(); all.equal(savObsAll, glbObsAll); all.equal(sav_models_lst, glb_models_lst)
#load(file = paste0(glbOut$pfx, "dsk_knitr.RData"))
#cmpCols <- names(glbObsAll)[!grepl("\\.Final\\.", names(glbObsAll))]; all.equal(savObsAll[, cmpCols], glbObsAll[, cmpCols]); all.equal(savObsAll[, "H.P.http"], glbObsAll[, "H.P.http"]); 

replay.petrisim(pn = glb_analytics_pn, 
    replay.trans = (glb_analytics_avl_objs <- c(glb_analytics_avl_objs, 
        "data.training.all.prediction","model.final")), flip_coord = TRUE)
## time trans    "bgn " "fit.data.training.all " "predict.data.new " "end " 
## 0.0000   multiple enabled transitions:  data.training.all data.new model.selected    firing:  model.selected 
## 1.0000    3   2 1 0 0 
## 1.0000   multiple enabled transitions:  data.training.all data.new model.selected model.final data.training.all.prediction   firing:  data.training.all.prediction 
## 2.0000    5   2 0 0 1
## Warning in replay.petrisim(pn = glb_analytics_pn, replay.trans =
## (glb_analytics_avl_objs <- c(glb_analytics_avl_objs, : Transition:
## model.final not enabled; adding missing token(s)
## Warning in replay.petrisim(pn = glb_analytics_pn, replay.trans
## = (glb_analytics_avl_objs <- c(glb_analytics_avl_objs, : Place:
## fit.data.training.all: added 1 missing token
## 2.0000   multiple enabled transitions:  data.training.all data.new model.selected model.final data.training.all.prediction   firing:  model.final 
## 3.0000    4   2 0 1 1

glb_chunks_df <- myadd_chunk(glb_chunks_df, "predict.data.new", major.inc = TRUE)
##               label step_major step_minor label_minor     bgn     end
## 4 fit.data.training          2          1           1 482.192 490.281
## 5  predict.data.new          3          0           0 490.282      NA
##   elapsed
## 4   8.089
## 5      NA

Step 3.0: predict data new

## Warning in glb_get_predictions(obs_df, mdl_id = glbMdlFinId, rsp_var =
## glb_rsp_var, : Using default probability threshold: 0.45

## Warning in glb_get_predictions(obs_df, mdl_id = glbMdlFinId, rsp_var =
## glb_rsp_var, : Using default probability threshold: 0.45
## Warning in glb_analytics_diag_plots(obs_df = glbObsNew, mdl_id =
## glbMdlFinId, : Limiting important feature scatter plots to 5 out of 182
## Warning: Removed 547 rows containing missing values (geom_point).

## Warning: Removed 547 rows containing missing values (geom_point).

## Warning: Removed 547 rows containing missing values (geom_point).

## Warning: Removed 547 rows containing missing values (geom_point).

## Warning: Removed 547 rows containing missing values (geom_point).

## Warning: Removed 547 rows containing missing values (geom_point).

## Warning: Removed 547 rows containing missing values (geom_point).

## Warning: Removed 547 rows containing missing values (geom_point).

## Warning: Removed 547 rows containing missing values (geom_point).

## Warning: Removed 547 rows containing missing values (geom_point).

## NULL
## Loading required package: tidyr
## 
## Attaching package: 'tidyr'
## The following object is masked from 'package:Matrix':
## 
##     expand
## [1] "OOBobs total range outliers: 0"
## [1] "newobs total range outliers: 0"
## [1] "Stacking file Q109244No_AllXpreProc_cnk03_rest_out_fin.csv to prediction outputs..."
## [1] 0.45
## [1] "glbMdlSelId: All.X#zv.pca#rcv#glmnet"
## [1] "glbMdlFinId: Final.All.X#zv.pca##glmnet"
## [1] "Cross Validation issues:"
##        MFO###myMFO_classfr  Random###myrandom_classfr 
##                          0                          0 
## Max.cor.Y.rcv.1X1###glmnet Final.All.X#zv.pca##glmnet 
##                          0                          0
##                                    max.Accuracy.OOB max.AUCROCR.OOB
## All.X#zv.pca#rcv#glmnet                   0.6185102       0.6396502
## Ensemble.auto.4##rcv#glmnet               0.6094808       0.6235304
## Ensemble.auto.1##rcv#glmnet               0.6072235       0.6397935
## Ensemble.auto.3##rcv#glmnet               0.6072235       0.6395887
## Ensemble.auto.2##rcv#glmnet               0.6072235       0.6395682
## All.X#zv.YeoJohnson.pca#rcv#glmnet        0.6049661       0.6418008
## Ensemble.auto.7##rcv#glmnet               0.6049661       0.6229978
## Ensemble.auto.6##rcv#glmnet               0.6027088       0.6253328
## Ensemble.auto.8##rcv#glmnet               0.6027088       0.6229773
## Ensemble.auto.9##rcv#glmnet               0.6027088       0.6229773
## Ensemble.auto.5##rcv#glmnet               0.6004515       0.6245955
## All.X#YeoJohnson#rcv#glmnet               0.6004515       0.6183995
## Ensemble.auto.10##rcv#glmnet              0.6004515       0.6129306
## All.X#expoTrans#rcv#glmnet                0.5981941       0.6183790
## All.X##rcv#glmnet                         0.5981941       0.6177236
## All.X#conditionalX#rcv#glmnet             0.5981941       0.6177236
## All.X#zv#rcv#glmnet                       0.5981941       0.6177236
## All.X#center#rcv#glmnet                   0.5981941       0.6177236
## All.X#scale#rcv#glmnet                    0.5981941       0.6177236
## All.X#center.scale#rcv#glmnet             0.5981941       0.6177236
## All.X#BoxCox#rcv#glmnet                   0.5981941       0.6177236
## All.X#range#rcv#glmnet                    0.5981941       0.6177031
## All.X##rcv#gbm                            0.5981941       0.6071853
## All.X##rcv#nnet                           0.5936795       0.6079329
## All.X##rcv#earth                          0.5891648       0.6300131
## All.X##rcv#bayesglm                       0.5891648       0.6229569
## All.X##rcv#glm                            0.5891648       0.6215845
## All.X##adaptive_cv#glmnet                 0.5891648       0.5972512
## All.X##rcv#bagEarth                       0.5869074       0.6166482
## All.X#nzv#rcv#glmnet                      0.5869074       0.6160338
## All.X##cv#glmnet                          0.5869074       0.6066527
## All.X##LGOCV#glmnet                       0.5869074       0.6066527
## All.X##boot#glmnet                        0.5869074       0.6066527
## Ensemble.auto.11##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.13##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.12##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.14##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.15##rcv#glmnet              0.5869074       0.6066527
## All.X##boot632#glmnet                     0.5869074       0.6066527
## Ensemble.auto.16##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.17##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.19##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.20##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.22##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.21##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.26##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.25##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.24##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.23##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.28##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.18##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.27##rcv#glmnet              0.5869074       0.6066527
## Ensemble.auto.29##rcv#glmnet              0.5869074       0.6066527
## All.X##rcv#rf                             0.5846501       0.5972512
## All.X##rcv#avNNet                         0.5846501       0.5963500
## Low.cor.X##rcv#glmnet                     0.5801354       0.6063250
## RFE.X##rcv#glmnet                         0.5733634       0.5998013
## Interact.High.cor.Y##rcv#glmnet           0.5733634       0.5847057
## All.X#spatialSign#rcv#glmnet              0.5620767       0.5909631
## All.X##rcv#rpart                          0.5530474       0.5700811
## Max.cor.Y.rcv.1X1###glmnet                0.5485327       0.5505203
## Max.cor.Y##rcv#rpart                      0.5440181       0.5511143
## All.X#ica#rcv#glmnet                      0.5417607       0.5020483
## Random###myrandom_classfr                 0.5349887       0.5054791
## MFO###myMFO_classfr                       0.5349887       0.5000000
## Final.All.X#zv.pca##glmnet                       NA              NA
##                                    max.AUCpROC.OOB
## All.X#zv.pca#rcv#glmnet                  0.6098275
## Ensemble.auto.4##rcv#glmnet              0.6042256
## Ensemble.auto.1##rcv#glmnet              0.6062431
## Ensemble.auto.3##rcv#glmnet              0.6059256
## Ensemble.auto.2##rcv#glmnet              0.6059256
## All.X#zv.YeoJohnson.pca#rcv#glmnet       0.5909119
## Ensemble.auto.7##rcv#glmnet              0.5955819
## Ensemble.auto.6##rcv#glmnet              0.5902974
## Ensemble.auto.8##rcv#glmnet              0.5955819
## Ensemble.auto.9##rcv#glmnet              0.5955819
## Ensemble.auto.5##rcv#glmnet              0.5954693
## All.X#YeoJohnson#rcv#glmnet              0.5511245
## Ensemble.auto.10##rcv#glmnet             0.5957867
## All.X#expoTrans#rcv#glmnet               0.5511245
## All.X##rcv#glmnet                        0.5514420
## All.X#conditionalX#rcv#glmnet            0.5514420
## All.X#zv#rcv#glmnet                      0.5514420
## All.X#center#rcv#glmnet                  0.5514420
## All.X#scale#rcv#glmnet                   0.5514420
## All.X#center.scale#rcv#glmnet            0.5514420
## All.X#BoxCox#rcv#glmnet                  0.5514420
## All.X#range#rcv#glmnet                   0.5514420
## All.X##rcv#gbm                           0.5939945
## All.X##rcv#nnet                          0.5793392
## All.X##rcv#earth                         0.5711769
## All.X##rcv#bayesglm                      0.5647761
## All.X##rcv#glm                           0.5801790
## All.X##adaptive_cv#glmnet                0.5777518
## All.X##rcv#bagEarth                      0.5831285
## All.X#nzv#rcv#glmnet                     0.5493323
## All.X##cv#glmnet                         0.5745770
## All.X##LGOCV#glmnet                      0.5745770
## All.X##boot#glmnet                       0.5745770
## Ensemble.auto.11##rcv#glmnet             0.5745770
## Ensemble.auto.13##rcv#glmnet             0.5745770
## Ensemble.auto.12##rcv#glmnet             0.5745770
## Ensemble.auto.14##rcv#glmnet             0.5745770
## Ensemble.auto.15##rcv#glmnet             0.5745770
## All.X##boot632#glmnet                    0.5745770
## Ensemble.auto.16##rcv#glmnet             0.5745770
## Ensemble.auto.17##rcv#glmnet             0.5745770
## Ensemble.auto.19##rcv#glmnet             0.5745770
## Ensemble.auto.20##rcv#glmnet             0.5745770
## Ensemble.auto.22##rcv#glmnet             0.5745770
## Ensemble.auto.21##rcv#glmnet             0.5745770
## Ensemble.auto.26##rcv#glmnet             0.5745770
## Ensemble.auto.25##rcv#glmnet             0.5745770
## Ensemble.auto.24##rcv#glmnet             0.5745770
## Ensemble.auto.23##rcv#glmnet             0.5745770
## Ensemble.auto.28##rcv#glmnet             0.5745770
## Ensemble.auto.18##rcv#glmnet             0.5745770
## Ensemble.auto.27##rcv#glmnet             0.5745770
## Ensemble.auto.29##rcv#glmnet             0.5745770
## All.X##rcv#rf                            0.5758470
## All.X##rcv#avNNet                        0.5765946
## Low.cor.X##rcv#glmnet                    0.5447954
## RFE.X##rcv#glmnet                        0.5496702
## Interact.High.cor.Y##rcv#glmnet          0.5682479
## All.X#spatialSign#rcv#glmnet             0.5453177
## All.X##rcv#rpart                         0.5522306
## Max.cor.Y.rcv.1X1###glmnet               0.5471714
## Max.cor.Y##rcv#rpart                     0.5471714
## All.X#ica#rcv#glmnet                     0.5072816
## Random###myrandom_classfr                0.5555897
## MFO###myMFO_classfr                      0.5000000
## Final.All.X#zv.pca##glmnet                      NA
##                                    min.elapsedtime.everything
## All.X#zv.pca#rcv#glmnet                                37.877
## Ensemble.auto.4##rcv#glmnet                             2.287
## Ensemble.auto.1##rcv#glmnet                             2.134
## Ensemble.auto.3##rcv#glmnet                             1.997
## Ensemble.auto.2##rcv#glmnet                             1.919
## All.X#zv.YeoJohnson.pca#rcv#glmnet                     92.648
## Ensemble.auto.7##rcv#glmnet                             2.203
## Ensemble.auto.6##rcv#glmnet                             2.160
## Ensemble.auto.8##rcv#glmnet                             2.178
## Ensemble.auto.9##rcv#glmnet                             2.214
## Ensemble.auto.5##rcv#glmnet                             2.078
## All.X#YeoJohnson#rcv#glmnet                            20.549
## Ensemble.auto.10##rcv#glmnet                            2.251
## All.X#expoTrans#rcv#glmnet                             41.608
## All.X##rcv#glmnet                                       8.285
## All.X#conditionalX#rcv#glmnet                           9.076
## All.X#zv#rcv#glmnet                                     9.668
## All.X#center#rcv#glmnet                                 9.949
## All.X#scale#rcv#glmnet                                  9.998
## All.X#center.scale#rcv#glmnet                          11.201
## All.X#BoxCox#rcv#glmnet                                12.743
## All.X#range#rcv#glmnet                                 10.244
## All.X##rcv#gbm                                         40.996
## All.X##rcv#nnet                                        51.376
## All.X##rcv#earth                                       32.993
## All.X##rcv#bayesglm                                    18.802
## All.X##rcv#glm                                         10.503
## All.X##adaptive_cv#glmnet                               4.892
## All.X##rcv#bagEarth                                  1073.451
## All.X#nzv#rcv#glmnet                                   12.237
## All.X##cv#glmnet                                        2.109
## All.X##LGOCV#glmnet                                     2.158
## All.X##boot#glmnet                                      2.185
## Ensemble.auto.11##rcv#glmnet                            2.286
## Ensemble.auto.13##rcv#glmnet                            2.287
## Ensemble.auto.12##rcv#glmnet                            2.350
## Ensemble.auto.14##rcv#glmnet                            2.369
## Ensemble.auto.15##rcv#glmnet                            2.389
## All.X##boot632#glmnet                                   2.414
## Ensemble.auto.16##rcv#glmnet                            2.441
## Ensemble.auto.17##rcv#glmnet                            2.481
## Ensemble.auto.19##rcv#glmnet                            2.497
## Ensemble.auto.20##rcv#glmnet                            2.586
## Ensemble.auto.22##rcv#glmnet                            2.615
## Ensemble.auto.21##rcv#glmnet                            2.636
## Ensemble.auto.26##rcv#glmnet                            2.654
## Ensemble.auto.25##rcv#glmnet                            2.680
## Ensemble.auto.24##rcv#glmnet                            2.700
## Ensemble.auto.23##rcv#glmnet                            2.741
## Ensemble.auto.28##rcv#glmnet                            2.795
## Ensemble.auto.18##rcv#glmnet                            2.823
## Ensemble.auto.27##rcv#glmnet                            2.887
## Ensemble.auto.29##rcv#glmnet                            2.900
## All.X##rcv#rf                                          31.736
## All.X##rcv#avNNet                                     103.553
## Low.cor.X##rcv#glmnet                                   8.077
## RFE.X##rcv#glmnet                                       2.464
## Interact.High.cor.Y##rcv#glmnet                         2.698
## All.X#spatialSign#rcv#glmnet                           14.076
## All.X##rcv#rpart                                        9.280
## Max.cor.Y.rcv.1X1###glmnet                              0.796
## Max.cor.Y##rcv#rpart                                    1.403
## All.X#ica#rcv#glmnet                                   21.649
## Random###myrandom_classfr                               0.301
## MFO###myMFO_classfr                                     0.455
## Final.All.X#zv.pca##glmnet                              2.118
##                                    max.Accuracy.fit opt.prob.threshold.fit
## All.X#zv.pca#rcv#glmnet                   0.5690120                   0.50
## Ensemble.auto.4##rcv#glmnet               0.9994256                   0.50
## Ensemble.auto.1##rcv#glmnet               0.6599656                   0.60
## Ensemble.auto.3##rcv#glmnet               0.6613076                   0.50
## Ensemble.auto.2##rcv#glmnet               0.6618823                   0.50
## All.X#zv.YeoJohnson.pca#rcv#glmnet        0.5778312                   0.50
## Ensemble.auto.7##rcv#glmnet               0.9994256                   0.50
## Ensemble.auto.6##rcv#glmnet               0.9994256                   0.50
## Ensemble.auto.8##rcv#glmnet               0.9994256                   0.50
## Ensemble.auto.9##rcv#glmnet               0.9994256                   0.50
## Ensemble.auto.5##rcv#glmnet               0.9994256                   0.50
## All.X#YeoJohnson#rcv#glmnet               0.5739975                   0.50
## Ensemble.auto.10##rcv#glmnet              0.9994256                   0.50
## All.X#expoTrans#rcv#glmnet                0.5738059                   0.50
## All.X##rcv#glmnet                         0.5764853                   0.50
## All.X#conditionalX#rcv#glmnet             0.5764853                   0.50
## All.X#zv#rcv#glmnet                       0.5764853                   0.50
## All.X#center#rcv#glmnet                   0.5764853                   0.50
## All.X#scale#rcv#glmnet                    0.5764853                   0.50
## All.X#center.scale#rcv#glmnet             0.5764853                   0.50
## All.X#BoxCox#rcv#glmnet                   0.5764853                   0.50
## All.X#range#rcv#glmnet                    0.5764853                   0.50
## All.X##rcv#gbm                            0.5805007                   0.50
## All.X##rcv#nnet                           0.5542802                   0.45
## All.X##rcv#earth                          0.5596389                   0.45
## All.X##rcv#bayesglm                       0.5456648                   0.50
## All.X##rcv#glm                            0.5462408                   0.50
## All.X##adaptive_cv#glmnet                 0.9994256                   0.50
## All.X##rcv#bagEarth                       0.5401372                   0.50
## All.X#nzv#rcv#glmnet                      0.5762963                   0.45
## All.X##cv#glmnet                          0.9994263                   0.50
## All.X##LGOCV#glmnet                       0.9992320                   0.50
## All.X##boot#glmnet                        1.0000000                   0.50
## Ensemble.auto.11##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.13##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.12##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.14##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.15##rcv#glmnet              0.9994256                   0.50
## All.X##boot632#glmnet                     0.9997887                   0.50
## Ensemble.auto.16##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.17##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.19##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.20##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.22##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.21##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.26##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.25##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.24##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.23##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.28##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.18##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.27##rcv#glmnet              0.9994256                   0.50
## Ensemble.auto.29##rcv#glmnet              0.9994256                   0.50
## All.X##rcv#rf                             0.9994256                   0.50
## All.X##rcv#avNNet                         0.5628910                   0.50
## Low.cor.X##rcv#glmnet                     0.5764843                   0.45
## RFE.X##rcv#glmnet                         0.5828137                   0.50
## Interact.High.cor.Y##rcv#glmnet           0.5540889                   0.50
## All.X#spatialSign#rcv#glmnet              0.5734181                   0.45
## All.X##rcv#rpart                          0.5466223                   0.50
## Max.cor.Y.rcv.1X1###glmnet                0.5588742                   0.50
## Max.cor.Y##rcv#rpart                      0.5588680                   0.50
## All.X#ica#rcv#glmnet                      0.5387702                   0.50
## Random###myrandom_classfr                 0.5364733                   0.55
## MFO###myMFO_classfr                       0.5364733                   0.50
## Final.All.X#zv.pca##glmnet                0.6648352                   0.45
##                                    opt.prob.threshold.OOB
## All.X#zv.pca#rcv#glmnet                              0.45
## Ensemble.auto.4##rcv#glmnet                          0.50
## Ensemble.auto.1##rcv#glmnet                          0.50
## Ensemble.auto.3##rcv#glmnet                          0.50
## Ensemble.auto.2##rcv#glmnet                          0.50
## All.X#zv.YeoJohnson.pca#rcv#glmnet                   0.45
## Ensemble.auto.7##rcv#glmnet                          0.55
## Ensemble.auto.6##rcv#glmnet                          0.55
## Ensemble.auto.8##rcv#glmnet                          0.55
## Ensemble.auto.9##rcv#glmnet                          0.55
## Ensemble.auto.5##rcv#glmnet                          0.50
## All.X#YeoJohnson#rcv#glmnet                          0.45
## Ensemble.auto.10##rcv#glmnet                         0.50
## All.X#expoTrans#rcv#glmnet                           0.45
## All.X##rcv#glmnet                                    0.45
## All.X#conditionalX#rcv#glmnet                        0.45
## All.X#zv#rcv#glmnet                                  0.45
## All.X#center#rcv#glmnet                              0.45
## All.X#scale#rcv#glmnet                               0.45
## All.X#center.scale#rcv#glmnet                        0.45
## All.X#BoxCox#rcv#glmnet                              0.45
## All.X#range#rcv#glmnet                               0.45
## All.X##rcv#gbm                                       0.50
## All.X##rcv#nnet                                      0.30
## All.X##rcv#earth                                     0.55
## All.X##rcv#bayesglm                                  0.45
## All.X##rcv#glm                                       0.45
## All.X##adaptive_cv#glmnet                            0.45
## All.X##rcv#bagEarth                                  0.50
## All.X#nzv#rcv#glmnet                                 0.45
## All.X##cv#glmnet                                     0.45
## All.X##LGOCV#glmnet                                  0.45
## All.X##boot#glmnet                                   0.45
## Ensemble.auto.11##rcv#glmnet                         0.45
## Ensemble.auto.13##rcv#glmnet                         0.45
## Ensemble.auto.12##rcv#glmnet                         0.45
## Ensemble.auto.14##rcv#glmnet                         0.45
## Ensemble.auto.15##rcv#glmnet                         0.45
## All.X##boot632#glmnet                                0.45
## Ensemble.auto.16##rcv#glmnet                         0.45
## Ensemble.auto.17##rcv#glmnet                         0.45
## Ensemble.auto.19##rcv#glmnet                         0.45
## Ensemble.auto.20##rcv#glmnet                         0.45
## Ensemble.auto.22##rcv#glmnet                         0.45
## Ensemble.auto.21##rcv#glmnet                         0.45
## Ensemble.auto.26##rcv#glmnet                         0.45
## Ensemble.auto.25##rcv#glmnet                         0.45
## Ensemble.auto.24##rcv#glmnet                         0.45
## Ensemble.auto.23##rcv#glmnet                         0.45
## Ensemble.auto.28##rcv#glmnet                         0.45
## Ensemble.auto.18##rcv#glmnet                         0.45
## Ensemble.auto.27##rcv#glmnet                         0.45
## Ensemble.auto.29##rcv#glmnet                         0.45
## All.X##rcv#rf                                        0.55
## All.X##rcv#avNNet                                    0.55
## Low.cor.X##rcv#glmnet                                0.45
## RFE.X##rcv#glmnet                                    0.45
## Interact.High.cor.Y##rcv#glmnet                      0.50
## All.X#spatialSign#rcv#glmnet                         0.50
## All.X##rcv#rpart                                     0.55
## Max.cor.Y.rcv.1X1###glmnet                           0.55
## Max.cor.Y##rcv#rpart                                 0.50
## All.X#ica#rcv#glmnet                                 0.50
## Random###myrandom_classfr                            0.55
## MFO###myMFO_classfr                                  0.50
## Final.All.X#zv.pca##glmnet                             NA
## [1] "All.X#zv.pca#rcv#glmnet OOB confusion matrix & accuracy: "
##          Prediction
## Reference   D   R
##         D 132 105
##         R  64 142
##     err.abs.fit.sum err.abs.OOB.sum err.abs.trn.sum err.abs.new.sum
## PKy        11.86102        1.086637        13.16833              NA
## N          92.23300       24.689085       116.66913              NA
## MKn        80.88852       19.089443        99.87173              NA
## SKn       340.18513      103.541909       443.20029              NA
## PKn        23.02028        4.839375        27.94177              NA
## SKy        19.44426        9.778182        28.99262              NA
## MKy       190.10070       40.247267       232.57025              NA
##     .freqRatio.Fit .freqRatio.OOB .freqRatio.Tst .n.Fit .n.New.D .n.New.R
## PKy     0.01608271    0.004514673    0.003656307     28        1        1
## N       0.12004595    0.108352144    0.107861060    209       23       36
## MKn     0.10798392    0.090293454    0.089579525    188       29       20
## SKn     0.44859276    0.501128668    0.504570384    781      143      133
## PKn     0.03216542    0.024830700    0.021937843     56       11        1
## SKy     0.02699598    0.051918736    0.051188300     47       10       18
## MKy     0.24813326    0.218961625    0.221206581    432       54       67
##     .n.OOB .n.Trn.D .n.Trn.R .n.Tst .n.fit .n.new .n.trn err.abs.OOB.mean
## PKy      2       12       18      2     28      2     30        0.5433185
## N       48      131      126     59    209     59    257        0.5143559
## MKn     40      124      104     49    188     49    228        0.4772361
## SKn    222      561      442    276    781    276   1003        0.4664050
## PKn     11       46       21     12     56     12     67        0.4399432
## SKy     23       37       33     28     47     28     70        0.4251384
## MKy     97      260      269    121    432    121    529        0.4149203
##     err.abs.fit.mean err.abs.new.mean err.abs.trn.mean
## PKy        0.4236078               NA        0.4389442
## N          0.4413062               NA        0.4539655
## MKn        0.4302581               NA        0.4380339
## SKn        0.4355763               NA        0.4418747
## PKn        0.4110764               NA        0.4170413
## SKy        0.4137076               NA        0.4141802
## MKy        0.4400479               NA        0.4396413
##  err.abs.fit.sum  err.abs.OOB.sum  err.abs.trn.sum  err.abs.new.sum 
##       757.732903       203.271898       962.414109               NA 
##   .freqRatio.Fit   .freqRatio.OOB   .freqRatio.Tst           .n.Fit 
##         1.000000         1.000000         1.000000      1741.000000 
##         .n.New.D         .n.New.R           .n.OOB         .n.Trn.D 
##       271.000000       276.000000       443.000000      1171.000000 
##         .n.Trn.R           .n.Tst           .n.fit           .n.new 
##      1013.000000       547.000000      1741.000000       547.000000 
##           .n.trn err.abs.OOB.mean err.abs.fit.mean err.abs.new.mean 
##      2184.000000         3.281317         2.995580               NA 
## err.abs.trn.mean 
##         3.043681
## [1] "Features Importance for selected models:"
##       All.X.zv.pca.rcv.glmnet.imp Final.All.X.zv.pca..glmnet.imp
## PC176                1.000000e+02                     39.7504818
## PC143                9.275090e+01                     46.7640067
## PC16                 8.520516e+01                     27.7333355
## PC170                7.479393e+01                     47.0773911
## PC35                 7.315796e+01                      6.8479330
## PC144                7.010065e+01                     14.2694009
## PC128                6.982828e+01                      8.5027014
## PC78                 6.978608e+01                     22.6176140
## PC130                6.950057e+01                    100.0000000
## PC33                 6.838701e+01                     12.2452460
## PC111                6.230038e+01                      0.0000000
## PC110                6.055558e+01                     11.6801702
## PC123                5.724446e+01                      0.0000000
## PC166                5.488771e+01                     49.9400943
## PC73                 5.291358e+01                     15.5662427
## PC165                5.257870e+01                      0.0000000
## PC29                 5.254738e+01                      2.8597341
## PC20                 5.129963e+01                     37.2581878
## PC163                5.034326e+01                     16.9912818
## PC21                 4.988859e+01                     67.6291473
## PC17                 4.985385e+01                     37.6340316
## PC115                4.921876e+01                      0.0000000
## PC106                4.872059e+01                      0.0000000
## PC113                4.852200e+01                     28.1272489
## PC47                 4.830536e+01                     22.5319977
## PC14                 4.646959e+01                     21.5576443
## PC138                4.559336e+01                      2.5712020
## PC44                 4.445818e+01                     19.0624764
## PC174                4.419996e+01                      3.6349766
## PC169                4.175077e+01                      0.0000000
## PC122                4.042866e+01                      4.7070287
## PC27                 4.033550e+01                     38.8512853
## PC53                 3.961769e+01                      0.0000000
## PC168                3.922960e+01                     17.4547735
## PC87                 3.885272e+01                      0.0000000
## PC83                 3.881538e+01                     19.7384404
## PC74                 3.832925e+01                     15.3029459
## PC10                 3.822141e+01                     18.8904392
## PC70                 3.815807e+01                      0.0000000
## PC137                3.728419e+01                     16.9504693
## PC155                3.706870e+01                      9.2180488
## PC124                3.662386e+01                      0.2418955
## PC8                  3.601150e+01                     30.9117104
## PC147                3.586515e+01                     19.0063835
## PC45                 3.501084e+01                      0.0000000
## PC153                3.481962e+01                     18.1008475
## PC6                  3.450937e+01                     31.7449693
## PC15                 3.401918e+01                      0.0000000
## PC11                 3.376872e+01                     19.9626104
## PC55                 3.366349e+01                      0.0000000
## PC9                  3.351613e+01                     23.9140094
## PC91                 3.343727e+01                      5.6951291
## PC89                 3.230346e+01                      5.6774383
## PC13                 3.070796e+01                      3.9714677
## PC180                2.996555e+01                      0.0000000
## PC34                 2.985494e+01                      9.9111577
## PC136                2.984962e+01                     36.7426511
## PC7                  2.909991e+01                     25.6944700
## PC28                 2.888611e+01                     70.8946101
## PC154                2.783634e+01                      0.0000000
## PC58                 2.727390e+01                     11.1143952
## PC135                2.697665e+01                     18.4779731
## PC75                 2.638460e+01                     13.8468267
## PC171                2.531038e+01                     13.3782616
## PC120                2.489996e+01                     55.3358766
## PC146                2.488196e+01                      0.0000000
## PC86                 2.485278e+01                     13.3447711
## PC94                 2.450185e+01                      0.0000000
## PC156                2.446547e+01                     18.2906884
## PC159                2.441279e+01                      0.0000000
## PC131                2.388039e+01                      0.0000000
## PC145                2.367954e+01                     22.3553864
## PC18                 2.357931e+01                     45.5370482
## PC24                 2.329016e+01                     21.9935040
## PC90                 2.319657e+01                      0.0000000
## PC4                  2.088729e+01                     11.8561818
## PC26                 2.038367e+01                     51.5920368
## PC60                 1.935100e+01                     21.7842379
## PC30                 1.897980e+01                      2.1469129
## PC38                 1.838838e+01                     17.0532725
## PC66                 1.699096e+01                     31.2076021
## PC148                1.685374e+01                     20.6352870
## PC98                 1.638492e+01                      0.0000000
## PC167                1.633314e+01                      0.0000000
## PC152                1.613821e+01                     24.4339200
## PC117                1.613769e+01                      0.0000000
## PC52                 1.524829e+01                     14.0037485
## PC69                 1.487455e+01                      0.0000000
## PC132                1.432095e+01                     40.2056225
## PC36                 1.345465e+01                     53.5826145
## PC112                1.338934e+01                      0.0000000
## PC57                 1.296634e+01                      2.5770127
## PC59                 1.263362e+01                      0.0000000
## PC64                 1.202000e+01                      0.0000000
## PC99                 1.130747e+01                      6.9211866
## PC141                1.112507e+01                     13.8388427
## PC161                1.062154e+01                     12.5917028
## PC77                 1.028165e+01                     29.7193577
## PC48                 1.022987e+01                     23.4502639
## PC95                 9.695666e+00                     11.3193024
## PC79                 7.362601e+00                     40.5758428
## PC23                 6.975107e+00                     11.0415398
## PC63                 6.468828e+00                     19.7138926
## PC139                4.823095e+00                     49.1075520
## PC177                4.053201e+00                     21.3510636
## PC54                 4.050821e+00                     22.1353875
## PC92                 3.818783e+00                     44.4511794
## PC162                3.612958e+00                     14.0926054
## PC101                1.176511e+00                     17.8342326
## PC142                6.509297e-01                     27.1053068
## PC164                1.321090e-01                     21.3710389
## PC12                 8.425935e-03                     45.1817693
## PC134                0.000000e+00                     62.6873757
## PC116                0.000000e+00                     59.7109782
## PC125                0.000000e+00                     53.0630014
## PC31                 0.000000e+00                     37.3390487
## PC85                 0.000000e+00                     34.9031946
## PC140                0.000000e+00                     28.0927410
## PC121                0.000000e+00                     27.7185609
## PC46                 0.000000e+00                     27.1077584
## PC50                 0.000000e+00                     27.0272641
## PC65                 0.000000e+00                     22.4359425
## PC158                0.000000e+00                     21.5721573
## PC25                 0.000000e+00                     21.5276110
## PC41                 0.000000e+00                     21.2769869
## PC127                0.000000e+00                     20.9398104
## PC126                0.000000e+00                     18.3783143
## PC32                 0.000000e+00                     15.5824392
## PC51                 0.000000e+00                     14.7363183
## PC67                 0.000000e+00                     12.7995887
## PC62                 0.000000e+00                     12.5560176
## PC150                0.000000e+00                     11.7760464
## PC68                 0.000000e+00                     10.6593573
## PC96                 0.000000e+00                     10.6186471
## PC104                0.000000e+00                     10.5997138
## PC182                          NA                     31.2291154
## [1] "glbObsNew prediction stats:"
## 
##   D   R 
## 271 276
##                  label step_major step_minor label_minor     bgn     end
## 5     predict.data.new          3          0           0 490.282 525.885
## 6 display.session.info          4          0           0 525.885      NA
##   elapsed
## 5  35.603
## 6      NA

Null Hypothesis (\(\sf{H_{0}}\)): mpg is not impacted by am_fctr.
The variance by am_fctr appears to be independent. #{r q1, cache=FALSE} # print(t.test(subset(cars_df, am_fctr == "automatic")$mpg, # subset(cars_df, am_fctr == "manual")$mpg, # var.equal=FALSE)$conf) # We reject the null hypothesis i.e. we have evidence to conclude that am_fctr impacts mpg (95% confidence). Manual transmission is better for miles per gallon versus automatic transmission.

##               label step_major step_minor label_minor     bgn     end
## 1      fit.models_2          1          0           0   9.814 436.304
## 2        fit.models          1          1           1 436.304 473.075
## 5  predict.data.new          3          0           0 490.282 525.885
## 3 fit.data.training          2          0           0 473.076 482.191
## 4 fit.data.training          2          1           1 482.192 490.281
##   elapsed duration
## 1 426.490  426.490
## 2  36.771   36.771
## 5  35.603   35.603
## 3   9.115    9.115
## 4   8.089    8.089
## [1] "Total Elapsed Time: 525.885 secs"

## [1] label       step_major  step_minor  label_minor bgn         end        
## [7] elapsed     duration   
## <0 rows> (or 0-length row.names)
## [1] "Total Elapsed Time: -Inf secs"